2023-12-19T13:16:10.891 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:16:10.891 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743 -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/orig.config.yaml 2023-12-19T13:16:10.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:16:11.015 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743 branch: rishabh-mdscap-reef description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: null first_in_suite: false job_id: '7496743' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdsdD00jk52f4SWwlcJkgBPxt6Hn8KZrl/wOFbZYoGWzRuWx2g+4x7d6HAh86IW3vRDLEs1ebQbL6QuOfledIM= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKggtyj6U7Gk0UCx1j07DqC5wBpV9T8wtNedcMCOSHXgw2q3m3rvhpWBpbR+BZw4t/0H2ia/LAGk4XTjX0I9rxs= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9HyulgJ5+WUTJbHQmdc6OtfTBq6eIKRbLsXZgrQ5P2uOwJpnxE+Q3WFa8r6914xk9yv3FleqXShjQ4DzdSSMY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_11:42:11 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T13:16:11.015 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-19T13:16:11.016 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-19T13:16:11.016 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T13:16:11.018 INFO:teuthology.task.internal:Checking packages... 2023-12-19T13:16:11.041 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-19T13:16:11.041 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T13:16:11.041 INFO:teuthology.packaging:ref: None 2023-12-19T13:16:11.041 INFO:teuthology.packaging:tag: None 2023-12-19T13:16:11.041 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-19T13:16:11.041 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:16:11.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-19T13:16:11.185 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-19T13:16:11.186 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T13:16:11.196 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T13:16:11.196 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T13:16:11.231 INFO:teuthology.task.internal:Saving configuration 2023-12-19T13:16:11.249 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T13:16:11.260 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:16:11.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:11:15.046341', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdsdD00jk52f4SWwlcJkgBPxt6Hn8KZrl/wOFbZYoGWzRuWx2g+4x7d6HAh86IW3vRDLEs1ebQbL6QuOfledIM='} 2023-12-19T13:16:11.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:11:15.044353', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKggtyj6U7Gk0UCx1j07DqC5wBpV9T8wtNedcMCOSHXgw2q3m3rvhpWBpbR+BZw4t/0H2ia/LAGk4XTjX0I9rxs='} 2023-12-19T13:16:11.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:11:15.048010', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9HyulgJ5+WUTJbHQmdc6OtfTBq6eIKRbLsXZgrQ5P2uOwJpnxE+Q3WFa8r6914xk9yv3FleqXShjQ4DzdSSMY='} 2023-12-19T13:16:11.329 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T13:16:11.340 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-12-19T13:16:11.340 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-19T13:16:11.340 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['client.0'] 2023-12-19T13:16:11.340 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T13:16:11.448 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4382d4dc0>, signals=[15]) 2023-12-19T13:16:11.449 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T13:16:11.460 INFO:teuthology.task.internal:Opening connections... 2023-12-19T13:16:11.460 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T13:16:11.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:16:11.559 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T13:16:11.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:16:11.643 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-12-19T13:16:11.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:16:11.729 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T13:16:11.741 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-12-19T13:16:11.759 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-12-19T13:16:11.759 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2023-12-19T13:16:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T13:16:11.818 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-12-19T13:16:11.818 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:16:11.818 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T13:16:11.818 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T13:16:11.818 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-12-19T13:16:11.840 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-12-19T13:16:11.858 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-12-19T13:16:11.858 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-19T13:16:11.914 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-12-19T13:16:11.914 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-12-19T13:16:11.914 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-12-19T13:16:11.914 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T13:16:11.915 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T13:16:11.915 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-19T13:16:11.940 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-12-19T13:16:11.957 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-12-19T13:16:11.958 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-12-19T13:16:12.012 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:16:12.013 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T13:16:12.014 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T13:16:12.014 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-12-19T13:16:12.048 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T13:16:12.057 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T13:16:12.069 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T13:16:12.070 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-12-19T13:16:12.072 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-12-19T13:16:12.075 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-12-19T13:16:12.091 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T13:16:12.102 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T13:16:12.103 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-12-19T13:16:12.130 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-12-19T13:16:12.132 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-12-19T13:16:12.168 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T13:16:12.243 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T13:16:12.262 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T13:16:12.263 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-12-19T13:16:12.263 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-12-19T13:16:12.263 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T13:16:12.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:16:12.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T13:16:12.464 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:16:12.464 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T13:16:12.464 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-12-19T13:16:12.482 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-361.el9.x86_64 2023-12-19T13:16:12.482 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:16:12.482 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T13:16:12.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2023-12-19T13:16:14.815 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - AppStream 8.2 MB/s | 6.4 MB 00:00 2023-12-19T13:16:16.315 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2023-12-19T13:16:17.206 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-12-19T13:16:20.615 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 18 MB 00:02 2023-12-19T13:16:24.782 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 5.8 MB 00:00 2023-12-19T13:16:26.117 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 15 kB 00:00 2023-12-19T13:16:27.712 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-19T13:16:32.492 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-19T13:16:34.730 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-12-19T13:16:34.738 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-12-19T13:16:34.739 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 1 Package 2023-12-19T13:16:34.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:16:34.739 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 328 M 2023-12-19T13:16:34.739 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-12-19T13:16:43.618 INFO:teuthology.orchestra.run.smithi144.stdout:linux-firmware-20231030-141.el9.noarch.rpm 37 MB/s | 328 MB 00:08 2023-12-19T13:16:43.619 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:16:43.619 INFO:teuthology.orchestra.run.smithi144.stdout:Total 37 MB/s | 328 MB 00:08 2023-12-19T13:16:43.619 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-12-19T13:16:43.710 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-12-19T13:16:43.710 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-12-19T13:16:45.878 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-12-19T13:16:45.879 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-12-19T13:16:51.826 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-12-19T13:16:52.183 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T13:16:52.265 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:16:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:16:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T13:16:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T13:16:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:16:53.653 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-12-19T13:16:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T13:16:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:16:53.653 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-12-19T13:16:53.960 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T13:16:53.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T13:16:54.181 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T13:16:54.181 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T13:16:54.184 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2023-12-19T13:17:34.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-12-19 13:17:34 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T13:17:34.629 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2023-12-19 13:17:34-- 2023-12-19T13:17:34.629 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 40s 2023-12-19T13:17:34.629 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 306M in 40s (7.65 MB/s) 2023-12-19T13:17:34.632 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T13:17:34.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T13:17:36.471 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2023-12-19T13:17:36.520 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2023-12-19T13:17:36.599 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2023-12-19T13:17:43.664 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T13:17:57.543 INFO:teuthology.orchestra.run.smithi144.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T13:18:18.747 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T13:18:18.747 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T13:18:18.807 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T13:18:18.808 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T13:18:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T13:18:18.810 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T13:18:18.811 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T13:18:18.812 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T13:18:18.813 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T13:18:18.814 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T13:18:18.815 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T13:18:18.816 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T13:18:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T13:18:18.818 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T13:18:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T13:18:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T13:18:18.821 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T13:18:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T13:18:18.823 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T13:18:18.824 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T13:18:18.825 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T13:18:18.826 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T13:18:18.827 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T13:18:18.828 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T13:18:18.829 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T13:18:18.830 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T13:18:18.831 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T13:18:18.832 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T13:18:18.833 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T13:18:18.834 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T13:18:18.835 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T13:18:18.836 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T13:18:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T13:18:18.838 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T13:18:18.839 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T13:18:18.840 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T13:18:18.841 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T13:18:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T13:18:18.843 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T13:18:18.844 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T13:18:18.845 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T13:18:18.846 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T13:18:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T13:18:18.848 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T13:18:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T13:18:18.850 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T13:18:18.851 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T13:18:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T13:18:18.853 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T13:18:18.854 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T13:18:18.855 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T13:18:18.856 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T13:18:18.857 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T13:18:18.858 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T13:18:18.859 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T13:18:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T13:18:18.861 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T13:18:18.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T13:18:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T13:18:18.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T13:18:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T13:18:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T13:18:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T13:18:18.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T13:18:18.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T13:18:18.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T13:18:18.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T13:18:18.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T13:18:18.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T13:18:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T13:18:18.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T13:18:18.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T13:18:18.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T13:18:18.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T13:18:18.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T13:18:18.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T13:18:18.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T13:18:18.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T13:18:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T13:18:18.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T13:18:18.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T13:18:18.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T13:18:18.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T13:18:18.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T13:18:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T13:18:18.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T13:18:18.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T13:18:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T13:18:18.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T13:18:18.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T13:18:18.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T13:18:18.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T13:18:18.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T13:18:18.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T13:18:18.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T13:18:18.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T13:18:18.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T13:18:18.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T13:18:18.903 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T13:18:18.904 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T13:18:18.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T13:18:18.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T13:18:18.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T13:18:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T13:18:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T13:18:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T13:18:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T13:18:18.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T13:18:18.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T13:18:18.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T13:18:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T13:18:18.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T13:18:18.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T13:18:18.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T13:18:18.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T13:18:18.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T13:18:18.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T13:18:18.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T13:18:18.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T13:18:18.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T13:18:18.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T13:18:18.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T13:18:18.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T13:18:18.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T13:18:18.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T13:18:18.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T13:18:18.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T13:18:18.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T13:18:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T13:18:18.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T13:18:18.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T13:18:18.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T13:18:18.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T13:18:18.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T13:18:18.939 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.939 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T13:18:18.962 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.963 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-12-19T13:18:18.964 INFO:teuthology.orchestra.run.smithi144.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T13:18:18.964 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T13:18:18.964 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T13:18:18.964 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-12-19T13:18:18.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2023-12-19T13:18:19.050 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 68.el9 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8264254 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2023-12-19T13:18:19.051 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:18:19.052 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T13:18:19.053 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T13:18:19.053 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.6.0-gcd68252d7b4d 2023-12-19T13:18:19.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T13:18:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2023-12-19T13:18:20.882 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T13:18:20.923 INFO:teuthology.orchestra.run.smithi144.stderr:done 2023-12-19T13:18:20.925 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-12-19T13:18:20.941 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.RQ6LnTQHuM 2023-12-19T13:18:20.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RQ6LnTQHuM 2023-12-19T13:18:21.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.RQ6LnTQHuM 2023-12-19T13:18:21.154 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.RQ6LnTQHuM is 6KB 2023-12-19T13:18:21.203 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.RQ6LnTQHuM 2023-12-19T13:18:21.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T13:18:21.283 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T13:18:21.283 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T13:18:21.283 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T13:18:21.283 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T13:18:21.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T13:18:21.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2023-12-19T13:18:51.456 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T13:18:51.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:18:51.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:19:09.841 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-19T13:19:18.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:19:18.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:19:21.905 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-19T13:19:33.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:19:33.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:19:52.337 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-12-19T13:20:07.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:20:07.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:20:09.919 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-12-19T13:20:10.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:20:10.511 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T13:20:10.511 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-12-19T13:20:10.555 INFO:teuthology.orchestra.run.smithi144.stdout:6.6.0-gcd68252d7b4d 2023-12-19T13:20:10.555 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T13:20:10.555 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T13:20:10.555 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T13:20:11.556 DEBUG:teuthology.parallel:result is None 2023-12-19T13:20:11.556 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T13:20:11.570 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T13:20:11.570 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T13:20:11.573 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T13:20:11.576 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T13:20:11.628 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T13:20:11.657 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T13:20:11.737 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T13:20:11.737 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T13:20:11.740 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T13:20:11.742 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T13:20:11.808 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T13:20:11.814 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T13:20:11.814 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T13:20:11.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:20:11.831 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T13:20:11.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:20:11.848 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T13:20:11.875 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T13:20:11.890 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T13:20:11.914 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:20:11.935 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:20:11.935 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:20:11.953 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:20:12.045 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:20:12.106 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T13:20:12.110 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T13:20:12.117 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T13:20:12.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T13:20:12.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T13:20:12.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T13:20:12.202 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T13:20:12.211 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T13:20:12.211 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T13:20:12.214 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T13:20:12.216 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T13:20:12.260 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:20:12.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:20:12.365 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:20:12.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:20:12.495 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:20:12.495 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T13:20:12.567 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:20:12.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:20:12.666 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:20:12.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:20:12.795 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:20:12.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T13:20:12.865 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:20:12.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T13:20:13.043 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:20:13.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T13:20:13.187 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:20:13.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T13:20:13.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-12-19T13:20:13.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-12-19T13:20:13.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-12-19T13:20:13.303 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T13:20:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T13:20:13.422 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T13:20:13.758 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T13:20:13.765 INFO:teuthology.task.internal:Starting timer... 2023-12-19T13:20:13.766 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T13:20:13.910 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T13:20:13.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-12-19T13:20:14.008 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2023-12-19T13:20:14.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-12-19T13:20:14.065 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-12-19T13:20:14.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-12-19T13:20:14.189 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2023-12-19T13:20:14.192 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T13:20:14.193 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-12-19T13:20:14.215 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-12-19T13:20:14.215 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-12-19T13:20:14.238 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-12-19T13:20:14.238 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-12-19T13:20:14.290 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-12-19T13:20:14.290 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2023-12-19T13:20:14.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T13:20:14.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:20:14.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T13:20:14.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:20:14.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T13:20:14.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:20:14.435 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T13:20:14.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-12-19T13:20:14.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-12-19T13:20:14.514 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-12-19T13:20:14.601 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T13:20:14.610 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-19T13:20:14.616 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-19T13:20:14.743 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T13:20:14.758 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T13:20:14.759 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi089.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T13:30:02.795 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2023-12-19T13:30:02.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-12-19T13:30:02.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:30:02.895 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-12-19T13:30:02.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-12-19T13:30:02.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-19T13:30:02.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:30:03.051 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-19T13:30:03.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-19T13:30:03.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:30:03.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:30:03.258 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-12-19T13:30:03.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-12-19T13:30:03.404 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T13:30:03.414 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T13:30:03.414 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T13:30:03.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T13:30:03.417 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T13:30:03.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T13:30:03.419 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T13:30:03.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T13:30:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T13:30:03.455 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T13:30:03.470 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T13:30:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T13:30:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-12-19T13:30:03.514 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-12-19T13:30:03.514 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-12-19T13:30:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T13:30:03.531 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T13:30:03.532 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-12-19T13:30:03.548 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T13:30:03.552 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T13:30:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T13:30:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T13:30:03.592 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-12-19T13:30:03.595 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T13:30:03.595 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-12-19T13:30:03.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2023-12-19T13:30:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T13:30:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-12-19T13:30:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.676 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-12-19T13:30:03.719 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-12-19T13:30:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T13:30:03.827 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T13:30:03.957 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2023-12-19T13:30:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T13:30:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-12-19T13:30:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.967 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.968 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T13:30:03.969 INFO:teuthology.run_tasks:Running task install... 2023-12-19T13:30:03.981 DEBUG:teuthology.task.install:project ceph 2023-12-19T13:30:03.981 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-19T13:30:03.981 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-19T13:30:03.981 INFO:teuthology.task.install:Using flavor: default 2023-12-19T13:30:03.987 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T13:30:03.987 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T13:30:03.988 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T13:30:03.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:30:03.990 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T13:30:03.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:30:03.991 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T13:30:03.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:30:04.132 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T13:30:04.133 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T13:30:04.317 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T13:30:04.317 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T13:30:04.325 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T13:30:04.325 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T13:30:04.420 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T13:30:04.420 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:30:04.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T13:30:04.430 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T13:30:04.431 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:30:04.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T13:30:04.432 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T13:30:04.433 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:30:04.433 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T13:30:04.459 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T13:30:04.459 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T13:30:04.464 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T13:30:04.464 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T13:30:04.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T13:30:04.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T13:30:04.539 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T13:30:04.540 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T13:30:04.619 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T13:30:04.627 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T13:30:04.658 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-12-19T13:30:04.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-12-19T13:30:04.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T13:30:04.686 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-12-19T13:30:04.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-12-19T13:30:04.812 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T13:30:04.904 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-12-19T13:30:04.906 INFO:teuthology.orchestra.run.smithi006.stdout:73 files removed 2023-12-19T13:30:04.908 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-12-19T13:30:04.922 INFO:teuthology.orchestra.run.smithi089.stdout:73 files removed 2023-12-19T13:30:04.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T13:30:04.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T13:30:05.275 INFO:teuthology.orchestra.run.smithi144.stdout:73 files removed 2023-12-19T13:30:05.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T13:30:05.583 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 227 kB/s | 77 kB 00:00 2023-12-19T13:30:05.752 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 150 kB/s | 77 kB 00:00 2023-12-19T13:30:06.159 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-12-19T13:30:06.177 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-19T13:30:06.340 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 152 kB/s | 77 kB 00:00 2023-12-19T13:30:06.559 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2023-12-19T13:30:06.695 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-12-19T13:30:06.932 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-12-19T13:30:07.328 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS-9 - AppStream 8.6 MB/s | 6.4 MB 00:00 2023-12-19T13:30:07.414 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - AppStream 9.3 MB/s | 6.4 MB 00:00 2023-12-19T13:30:07.508 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-12-19T13:30:08.328 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - AppStream 8.6 MB/s | 6.4 MB 00:00 2023-12-19T13:30:08.720 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-12-19T13:30:08.797 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-12-19T13:30:09.720 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-12-19T13:30:09.903 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2023-12-19T13:30:10.288 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 7.9 MB 00:01 2023-12-19T13:30:11.274 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 7.9 MB/s | 7.9 MB 00:00 2023-12-19T13:30:12.184 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-12-19T13:30:13.631 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 18 MB 00:02 2023-12-19T13:30:13.709 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 15 MB/s | 18 MB 00:01 2023-12-19T13:30:17.675 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-12-19T13:30:18.527 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 5.8 MB 00:01 2023-12-19T13:30:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-12-19T13:30:19.331 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-12-19T13:30:20.193 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-19T13:30:20.207 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2023-12-19T13:30:20.718 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-12-19T13:30:21.261 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2023-12-19T13:30:24.604 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 4.7 MB/s | 20 MB 00:04 2023-12-19T13:30:25.741 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-19T13:30:25.910 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-12-19T13:30:28.211 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:30:28.211 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:30:28.226 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T13:30:28.227 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T13:30:28.228 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T13:30:28.229 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T13:30:28.231 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:30:28.234 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T13:30:28.235 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:30:28.299 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:30:28.299 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:30:28.313 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T13:30:28.314 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-12-19T13:30:28.314 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T13:30:28.315 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T13:30:28.316 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T13:30:28.318 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:30:28.321 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T13:30:28.322 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================ 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================ 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T13:30:28.337 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T13:30:28.338 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T13:30:28.339 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T13:30:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:30:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T13:30:28.342 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T13:30:28.343 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T13:30:28.344 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T13:30:28.345 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T13:30:28.346 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T13:30:28.347 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T13:30:28.348 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================ 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:Install 139 Packages 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 15 Packages 2023-12-19T13:30:28.349 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:30:28.350 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 200 M 2023-12-19T13:30:28.350 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-12-19T13:30:28.396 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T13:30:28.413 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T13:30:28.414 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T13:30:28.415 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T13:30:28.416 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T13:30:28.417 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T13:30:28.418 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T13:30:28.419 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T13:30:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T13:30:28.421 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T13:30:28.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T13:30:28.423 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-19T13:30:28.424 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-12-19T13:30:28.425 INFO:teuthology.orchestra.run.smithi089.stdout:Install 139 Packages 2023-12-19T13:30:28.425 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 15 Packages 2023-12-19T13:30:28.425 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:30:28.425 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 200 M 2023-12-19T13:30:28.425 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-19T13:30:28.996 INFO:teuthology.orchestra.run.smithi089.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2023-12-19T13:30:29.025 INFO:teuthology.orchestra.run.smithi006.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-12-19T13:30:29.238 INFO:teuthology.orchestra.run.smithi089.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 3.4 MB/s | 839 kB 00:00 2023-12-19T13:30:29.330 INFO:teuthology.orchestra.run.smithi089.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 1.5 MB/s | 142 kB 00:00 2023-12-19T13:30:29.625 INFO:teuthology.orchestra.run.smithi006.stdout:(2/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 5.6 MB/s | 5.2 MB 00:00 2023-12-19T13:30:29.692 INFO:teuthology.orchestra.run.smithi006.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 2.1 MB/s | 142 kB 00:00 2023-12-19T13:30:29.784 INFO:teuthology.orchestra.run.smithi006.stdout:(4/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.1 MB/s | 839 kB 00:00 2023-12-19T13:30:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:(4/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 3.8 MB/s | 2.1 MB 00:00 2023-12-19T13:30:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:(5/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 4.2 MB/s | 5.2 MB 00:01 2023-12-19T13:30:30.026 INFO:teuthology.orchestra.run.smithi006.stdout:(5/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 6.3 MB/s | 2.1 MB 00:00 2023-12-19T13:30:30.147 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-12-19T13:30:30.672 INFO:teuthology.orchestra.run.smithi089.stdout:(6/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 1.8 MB/s | 1.4 MB 00:00 2023-12-19T13:30:30.831 INFO:teuthology.orchestra.run.smithi089.stdout:(7/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 5.3 MB/s | 4.4 MB 00:00 2023-12-19T13:30:31.126 INFO:teuthology.orchestra.run.smithi006.stdout:(6/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 1.1 MB/s | 1.4 MB 00:01 2023-12-19T13:30:31.352 INFO:teuthology.orchestra.run.smithi006.stdout:(7/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 3.3 MB/s | 4.4 MB 00:01 2023-12-19T13:30:32.098 INFO:teuthology.orchestra.run.smithi089.stdout:(8/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 6.1 MB/s | 7.7 MB 00:01 2023-12-19T13:30:32.119 INFO:teuthology.orchestra.run.smithi006.stdout:(8/154): ceph-common-18.2.0-1377.g24e2e32a.el9. 5.4 MB/s | 18 MB 00:03 2023-12-19T13:30:32.156 INFO:teuthology.orchestra.run.smithi089.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 415 kB/s | 24 kB 00:00 2023-12-19T13:30:32.177 INFO:teuthology.orchestra.run.smithi006.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 416 kB/s | 24 kB 00:00 2023-12-19T13:30:32.373 INFO:teuthology.orchestra.run.smithi089.stdout:(10/154): ceph-common-18.2.0-1377.g24e2e32a.el9 5.1 MB/s | 18 MB 00:03 2023-12-19T13:30:32.499 INFO:teuthology.orchestra.run.smithi089.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.7 MB/s | 219 kB 00:00 2023-12-19T13:30:32.591 INFO:teuthology.orchestra.run.smithi089.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 295 kB/s | 27 kB 00:00 2023-12-19T13:30:32.658 INFO:teuthology.orchestra.run.smithi089.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 466 kB/s | 31 kB 00:00 2023-12-19T13:30:32.678 INFO:teuthology.orchestra.run.smithi006.stdout:(10/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el 5.8 MB/s | 7.7 MB 00:01 2023-12-19T13:30:32.805 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:30:32.806 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T13:30:32.811 INFO:teuthology.orchestra.run.smithi006.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.6 MB/s | 219 kB 00:00 2023-12-19T13:30:32.829 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T13:30:32.830 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T13:30:32.831 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T13:30:32.833 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T13:30:32.835 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:30:32.839 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T13:30:32.840 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:30:32.858 INFO:teuthology.orchestra.run.smithi089.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 3.2 MB/s | 658 kB 00:00 2023-12-19T13:30:32.886 INFO:teuthology.orchestra.run.smithi006.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 360 kB/s | 27 kB 00:00 2023-12-19T13:30:32.920 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================ 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================ 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T13:30:32.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T13:30:32.945 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:30:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T13:30:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T13:30:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T13:30:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T13:30:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T13:30:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T13:30:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T13:30:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T13:30:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================ 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:Install 139 Packages 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 15 Packages 2023-12-19T13:30:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:30:32.956 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 200 M 2023-12-19T13:30:32.956 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-12-19T13:30:32.958 INFO:teuthology.orchestra.run.smithi089.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.6 MB/s | 166 kB 00:00 2023-12-19T13:30:32.961 INFO:teuthology.orchestra.run.smithi006.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 414 kB/s | 31 kB 00:00 2023-12-19T13:30:33.083 INFO:teuthology.orchestra.run.smithi089.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 1.0 MB/s | 127 kB 00:00 2023-12-19T13:30:33.170 INFO:teuthology.orchestra.run.smithi006.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 3.1 MB/s | 658 kB 00:00 2023-12-19T13:30:33.259 INFO:teuthology.orchestra.run.smithi089.stdout:(17/154): libradosstriper1-18.2.0-1377.g24e2e32 2.6 MB/s | 474 kB 00:00 2023-12-19T13:30:33.270 INFO:teuthology.orchestra.run.smithi006.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.6 MB/s | 166 kB 00:00 2023-12-19T13:30:33.371 INFO:teuthology.orchestra.run.smithi006.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 1.2 MB/s | 127 kB 00:00 2023-12-19T13:30:33.546 INFO:teuthology.orchestra.run.smithi006.stdout:(17/154): libradosstriper1-18.2.0-1377.g24e2e32 2.7 MB/s | 474 kB 00:00 2023-12-19T13:30:33.765 INFO:teuthology.orchestra.run.smithi144.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-12-19T13:30:34.242 INFO:teuthology.orchestra.run.smithi089.stdout:(18/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 4.5 MB/s | 4.5 MB 00:00 2023-12-19T13:30:34.371 INFO:teuthology.orchestra.run.smithi006.stdout:(18/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 5.4 MB/s | 4.5 MB 00:00 2023-12-19T13:30:40.859 INFO:teuthology.orchestra.run.smithi089.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 6.8 kB/s | 45 kB 00:06 2023-12-19T13:30:40.862 INFO:teuthology.orchestra.run.smithi006.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 6.9 kB/s | 45 kB 00:06 2023-12-19T13:30:40.931 INFO:teuthology.orchestra.run.smithi144.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 117 kB/s | 839 kB 00:07 2023-12-19T13:30:40.992 INFO:teuthology.orchestra.run.smithi089.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 936 kB/s | 124 kB 00:00 2023-12-19T13:30:41.046 INFO:teuthology.orchestra.run.smithi006.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 680 kB/s | 124 kB 00:00 2023-12-19T13:30:41.923 INFO:teuthology.orchestra.run.smithi144.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 144 kB/s | 142 kB 00:00 2023-12-19T13:30:42.067 INFO:teuthology.orchestra.run.smithi089.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 150 kB/s | 162 kB 00:01 2023-12-19T13:30:42.105 INFO:teuthology.orchestra.run.smithi006.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 153 kB/s | 162 kB 00:01 2023-12-19T13:30:42.630 INFO:teuthology.orchestra.run.smithi006.stdout:(22/154): python3-rados-18.2.0-1377.g24e2e32a.e 609 kB/s | 319 kB 00:00 2023-12-19T13:30:42.651 INFO:teuthology.orchestra.run.smithi089.stdout:(22/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 1.5 MB/s | 18 MB 00:11 2023-12-19T13:30:42.676 INFO:teuthology.orchestra.run.smithi089.stdout:(23/154): python3-rados-18.2.0-1377.g24e2e32a.e 525 kB/s | 319 kB 00:00 2023-12-19T13:30:42.794 INFO:teuthology.orchestra.run.smithi089.stdout:(24/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 850 kB/s | 99 kB 00:00 2023-12-19T13:30:42.819 INFO:teuthology.orchestra.run.smithi089.stdout:(25/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 1.7 MB/s | 297 kB 00:00 2023-12-19T13:30:42.838 INFO:teuthology.orchestra.run.smithi006.stdout:(23/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 1.4 MB/s | 297 kB 00:00 2023-12-19T13:30:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:(24/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.3 MB/s | 99 kB 00:00 2023-12-19T13:30:42.981 INFO:teuthology.orchestra.run.smithi006.stdout:(25/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.3 MB/s | 87 kB 00:00 2023-12-19T13:30:43.178 INFO:teuthology.orchestra.run.smithi089.stdout:(26/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 3.6 MB/s | 40 MB 00:11 2023-12-19T13:30:43.203 INFO:teuthology.orchestra.run.smithi089.stdout:(27/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 212 kB/s | 87 kB 00:00 2023-12-19T13:30:43.241 INFO:teuthology.orchestra.run.smithi144.stdout:(4/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.6 MB/s | 2.1 MB 00:01 2023-12-19T13:30:43.270 INFO:teuthology.orchestra.run.smithi089.stdout:(28/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.8 MB/s | 171 kB 00:00 2023-12-19T13:30:43.295 INFO:teuthology.orchestra.run.smithi089.stdout:(29/154): ceph-grafana-dashboards-18.2.0-1377.g 252 kB/s | 23 kB 00:00 2023-12-19T13:30:43.353 INFO:teuthology.orchestra.run.smithi089.stdout:(30/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.5 MB/s | 132 kB 00:00 2023-12-19T13:30:43.549 INFO:teuthology.orchestra.run.smithi144.stdout:(5/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 522 kB/s | 5.2 MB 00:10 2023-12-19T13:30:43.729 INFO:teuthology.orchestra.run.smithi089.stdout:(31/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 4.0 MB/s | 1.8 MB 00:00 2023-12-19T13:30:43.815 INFO:teuthology.orchestra.run.smithi144.stdout:(6/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 2.5 MB/s | 1.4 MB 00:00 2023-12-19T13:30:43.846 INFO:teuthology.orchestra.run.smithi089.stdout:(32/154): ceph-mgr-modules-core-18.2.0-1377.g24 2.0 MB/s | 242 kB 00:00 2023-12-19T13:30:43.946 INFO:teuthology.orchestra.run.smithi089.stdout:(33/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 503 kB/s | 50 kB 00:00 2023-12-19T13:30:43.996 INFO:teuthology.orchestra.run.smithi089.stdout:(34/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 2.5 MB/s | 3.0 MB 00:01 2023-12-19T13:30:44.022 INFO:teuthology.orchestra.run.smithi089.stdout:(35/154): ceph-prometheus-alerts-18.2.0-1377.g2 194 kB/s | 15 kB 00:00 2023-12-19T13:30:44.147 INFO:teuthology.orchestra.run.smithi089.stdout:(36/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.7 MB/s | 221 kB 00:00 2023-12-19T13:30:44.172 INFO:teuthology.orchestra.run.smithi089.stdout:(37/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.5 MB/s | 262 kB 00:00 2023-12-19T13:30:44.239 INFO:teuthology.orchestra.run.smithi089.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 197 kB/s | 18 kB 00:00 2023-12-19T13:30:44.298 INFO:teuthology.orchestra.run.smithi006.stdout:(26/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 2.3 MB/s | 3.0 MB 00:01 2023-12-19T13:30:44.331 INFO:teuthology.orchestra.run.smithi089.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 920 kB 00:00 2023-12-19T13:30:44.365 INFO:teuthology.orchestra.run.smithi089.stdout:(40/154): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-19T13:30:44.390 INFO:teuthology.orchestra.run.smithi089.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-12-19T13:30:44.407 INFO:teuthology.orchestra.run.smithi089.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 517 kB/s | 21 kB 00:00 2023-12-19T13:30:44.431 INFO:teuthology.orchestra.run.smithi006.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.3 MB/s | 171 kB 00:00 2023-12-19T13:30:44.432 INFO:teuthology.orchestra.run.smithi089.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-19T13:30:44.450 INFO:teuthology.orchestra.run.smithi089.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 765 kB/s | 32 kB 00:00 2023-12-19T13:30:44.507 INFO:teuthology.orchestra.run.smithi006.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 309 kB/s | 23 kB 00:00 2023-12-19T13:30:44.600 INFO:teuthology.orchestra.run.smithi089.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2023-12-19T13:30:44.617 INFO:teuthology.orchestra.run.smithi089.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 103 kB/s | 17 kB 00:00 2023-12-19T13:30:44.623 INFO:teuthology.orchestra.run.smithi006.stdout:(29/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.1 MB/s | 132 kB 00:00 2023-12-19T13:30:44.642 INFO:teuthology.orchestra.run.smithi089.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-12-19T13:30:44.659 INFO:teuthology.orchestra.run.smithi089.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 242 kB/s | 10 kB 00:00 2023-12-19T13:30:44.685 INFO:teuthology.orchestra.run.smithi089.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-19T13:30:44.702 INFO:teuthology.orchestra.run.smithi089.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-19T13:30:44.811 INFO:teuthology.orchestra.run.smithi089.stdout:(51/154): ceph-mgr-diskprediction-local-18.2.0- 5.1 MB/s | 7.4 MB 00:01 2023-12-19T13:30:44.836 INFO:teuthology.orchestra.run.smithi089.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 661 kB 00:00 2023-12-19T13:30:44.861 INFO:teuthology.orchestra.run.smithi089.stdout:(53/154): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 578 kB 00:00 2023-12-19T13:30:44.878 INFO:teuthology.orchestra.run.smithi089.stdout:(54/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 374 kB/s | 24 kB 00:00 2023-12-19T13:30:44.903 INFO:teuthology.orchestra.run.smithi089.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-12-19T13:30:44.920 INFO:teuthology.orchestra.run.smithi089.stdout:(56/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 790 kB/s | 46 kB 00:00 2023-12-19T13:30:44.945 INFO:teuthology.orchestra.run.smithi089.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2023-12-19T13:30:44.962 INFO:teuthology.orchestra.run.smithi089.stdout:(58/154): openblas-0.3.21-2.el9.x86_64.rpm 588 kB/s | 34 kB 00:00 2023-12-19T13:30:45.038 INFO:teuthology.orchestra.run.smithi089.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2023-12-19T13:30:45.138 INFO:teuthology.orchestra.run.smithi089.stdout:(60/154): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2023-12-19T13:30:45.172 INFO:teuthology.orchestra.run.smithi089.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.8 MB/s | 811 kB 00:00 2023-12-19T13:30:45.197 INFO:teuthology.orchestra.run.smithi089.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 857 kB/s | 134 kB 00:00 2023-12-19T13:30:45.249 INFO:teuthology.orchestra.run.smithi144.stdout:(7/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 2.6 MB/s | 4.4 MB 00:01 2023-12-19T13:30:45.330 INFO:teuthology.orchestra.run.smithi089.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2023-12-19T13:30:45.356 INFO:teuthology.orchestra.run.smithi089.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 499 kB/s | 78 kB 00:00 2023-12-19T13:30:45.365 INFO:teuthology.orchestra.run.smithi006.stdout:(30/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 3.0 MB/s | 40 MB 00:13 2023-12-19T13:30:45.456 INFO:teuthology.orchestra.run.smithi089.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-12-19T13:30:45.481 INFO:teuthology.orchestra.run.smithi089.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2023-12-19T13:30:45.507 INFO:teuthology.orchestra.run.smithi089.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 165 kB/s | 24 kB 00:00 2023-12-19T13:30:45.532 INFO:teuthology.orchestra.run.smithi089.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2023-12-19T13:30:45.599 INFO:teuthology.orchestra.run.smithi089.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 345 kB/s | 32 kB 00:00 2023-12-19T13:30:45.607 INFO:teuthology.orchestra.run.smithi006.stdout:(31/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 1.8 MB/s | 1.8 MB 00:00 2023-12-19T13:30:45.658 INFO:teuthology.orchestra.run.smithi089.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 959 kB/s | 144 kB 00:00 2023-12-19T13:30:45.683 INFO:teuthology.orchestra.run.smithi006.stdout:(32/154): ceph-mgr-modules-core-18.2.0-1377.g24 3.2 MB/s | 242 kB 00:00 2023-12-19T13:30:45.685 INFO:teuthology.orchestra.run.smithi144.stdout:(8/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x86 9.4 MB/s | 18 MB 00:01 2023-12-19T13:30:45.724 INFO:teuthology.orchestra.run.smithi089.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-12-19T13:30:45.733 INFO:teuthology.orchestra.run.smithi006.stdout:(33/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 1.0 MB/s | 50 kB 00:00 2023-12-19T13:30:45.741 INFO:teuthology.orchestra.run.smithi144.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 442 kB/s | 24 kB 00:00 2023-12-19T13:30:45.750 INFO:teuthology.orchestra.run.smithi089.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-12-19T13:30:45.769 INFO:teuthology.orchestra.run.smithi006.stdout:(34/154): ceph-prometheus-alerts-18.2.0-1377.g2 414 kB/s | 15 kB 00:00 2023-12-19T13:30:45.775 INFO:teuthology.orchestra.run.smithi089.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 174 kB 00:00 2023-12-19T13:30:45.800 INFO:teuthology.orchestra.run.smithi089.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 827 kB/s | 41 kB 00:00 2023-12-19T13:30:45.825 INFO:teuthology.orchestra.run.smithi089.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-12-19T13:30:45.851 INFO:teuthology.orchestra.run.smithi089.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-12-19T13:30:45.868 INFO:teuthology.orchestra.run.smithi089.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2023-12-19T13:30:45.884 INFO:teuthology.orchestra.run.smithi089.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 734 kB/s | 43 kB 00:00 2023-12-19T13:30:45.911 INFO:teuthology.orchestra.run.smithi006.stdout:(35/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.8 MB/s | 262 kB 00:00 2023-12-19T13:30:46.061 INFO:teuthology.orchestra.run.smithi006.stdout:(36/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.4 MB/s | 221 kB 00:00 2023-12-19T13:30:46.076 INFO:teuthology.orchestra.run.smithi089.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 203 kB/s | 39 kB 00:00 2023-12-19T13:30:46.093 INFO:teuthology.orchestra.run.smithi089.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 197 kB/s | 41 kB 00:00 2023-12-19T13:30:46.153 INFO:teuthology.orchestra.run.smithi006.stdout:(37/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 198 kB/s | 18 kB 00:00 2023-12-19T13:30:46.336 INFO:teuthology.orchestra.run.smithi006.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2023-12-19T13:30:46.361 INFO:teuthology.orchestra.run.smithi089.stdout:(81/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2023-12-19T13:30:46.386 INFO:teuthology.orchestra.run.smithi089.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 972 kB/s | 300 kB 00:00 2023-12-19T13:30:46.395 INFO:teuthology.orchestra.run.smithi006.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2023-12-19T13:30:46.403 INFO:teuthology.orchestra.run.smithi089.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 183 kB/s | 56 kB 00:00 2023-12-19T13:30:46.428 INFO:teuthology.orchestra.run.smithi089.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-12-19T13:30:46.437 INFO:teuthology.orchestra.run.smithi006.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-19T13:30:46.453 INFO:teuthology.orchestra.run.smithi089.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-19T13:30:46.478 INFO:teuthology.orchestra.run.smithi089.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2023-12-19T13:30:46.479 INFO:teuthology.orchestra.run.smithi006.stdout:(41/154): elfutils-libelf-devel-0.190-1.el9.x86 518 kB/s | 21 kB 00:00 2023-12-19T13:30:46.504 INFO:teuthology.orchestra.run.smithi089.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-19T13:30:46.529 INFO:teuthology.orchestra.run.smithi089.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2023-12-19T13:30:46.571 INFO:teuthology.orchestra.run.smithi006.stdout:(42/154): ceph-mgr-diskprediction-local-18.2.0- 6.1 MB/s | 7.4 MB 00:01 2023-12-19T13:30:46.571 INFO:teuthology.orchestra.run.smithi089.stdout:(89/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-12-19T13:30:46.596 INFO:teuthology.orchestra.run.smithi006.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 307 kB 00:00 2023-12-19T13:30:46.621 INFO:teuthology.orchestra.run.smithi006.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 642 kB/s | 32 kB 00:00 2023-12-19T13:30:46.630 INFO:teuthology.orchestra.run.smithi089.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2023-12-19T13:30:46.671 INFO:teuthology.orchestra.run.smithi089.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.1 MB 00:00 2023-12-19T13:30:46.697 INFO:teuthology.orchestra.run.smithi089.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-19T13:30:46.722 INFO:teuthology.orchestra.run.smithi089.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2023-12-19T13:30:46.730 INFO:teuthology.orchestra.run.smithi006.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2023-12-19T13:30:46.747 INFO:teuthology.orchestra.run.smithi089.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-19T13:30:46.755 INFO:teuthology.orchestra.run.smithi006.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 130 kB/s | 17 kB 00:00 2023-12-19T13:30:46.772 INFO:teuthology.orchestra.run.smithi089.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-19T13:30:46.780 INFO:teuthology.orchestra.run.smithi006.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-19T13:30:46.806 INFO:teuthology.orchestra.run.smithi006.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2023-12-19T13:30:46.831 INFO:teuthology.orchestra.run.smithi006.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-19T13:30:46.856 INFO:teuthology.orchestra.run.smithi006.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 887 kB/s | 44 kB 00:00 2023-12-19T13:30:46.890 INFO:teuthology.orchestra.run.smithi006.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-19T13:30:46.915 INFO:teuthology.orchestra.run.smithi006.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2023-12-19T13:30:46.931 INFO:teuthology.orchestra.run.smithi089.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 700 kB/s | 111 kB 00:00 2023-12-19T13:30:46.941 INFO:teuthology.orchestra.run.smithi006.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 498 kB/s | 24 kB 00:00 2023-12-19T13:30:46.966 INFO:teuthology.orchestra.run.smithi006.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 925 kB/s | 46 kB 00:00 2023-12-19T13:30:46.991 INFO:teuthology.orchestra.run.smithi006.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-19T13:30:47.015 INFO:teuthology.orchestra.run.smithi089.stdout:(97/154): python3-devel-3.9.17-2.el9.x86_64.rpm 919 kB/s | 245 kB 00:00 2023-12-19T13:30:47.025 INFO:teuthology.orchestra.run.smithi006.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2023-12-19T13:30:47.040 INFO:teuthology.orchestra.run.smithi089.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2023-12-19T13:30:47.050 INFO:teuthology.orchestra.run.smithi006.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 582 kB/s | 34 kB 00:00 2023-12-19T13:30:47.099 INFO:teuthology.orchestra.run.smithi089.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 447 kB/s | 26 kB 00:00 2023-12-19T13:30:47.157 INFO:teuthology.orchestra.run.smithi089.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2023-12-19T13:30:47.199 INFO:teuthology.orchestra.run.smithi089.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-12-19T13:30:47.242 INFO:teuthology.orchestra.run.smithi006.stdout:(58/154): postgresql-13.11-1.el9.x86_64.rpm 7.9 MB/s | 1.5 MB 00:00 2023-12-19T13:30:47.316 INFO:teuthology.orchestra.run.smithi089.stdout:(102/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2023-12-19T13:30:47.359 INFO:teuthology.orchestra.run.smithi006.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2023-12-19T13:30:47.383 INFO:teuthology.orchestra.run.smithi089.stdout:(103/154): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2023-12-19T13:30:47.393 INFO:teuthology.orchestra.run.smithi006.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 5.3 MB/s | 811 kB 00:00 2023-12-19T13:30:47.417 INFO:teuthology.orchestra.run.smithi089.stdout:(104/154): python3-asyncssh-2.13.2-3.el9.noarch 5.3 MB/s | 548 kB 00:00 2023-12-19T13:30:47.426 INFO:teuthology.orchestra.run.smithi006.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-12-19T13:30:47.442 INFO:teuthology.orchestra.run.smithi089.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2023-12-19T13:30:47.468 INFO:teuthology.orchestra.run.smithi089.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2023-12-19T13:30:47.493 INFO:teuthology.orchestra.run.smithi089.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2023-12-19T13:30:47.518 INFO:teuthology.orchestra.run.smithi089.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2023-12-19T13:30:47.552 INFO:teuthology.orchestra.run.smithi089.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2023-12-19T13:30:47.577 INFO:teuthology.orchestra.run.smithi089.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2023-12-19T13:30:47.603 INFO:teuthology.orchestra.run.smithi089.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 704 kB/s | 35 kB 00:00 2023-12-19T13:30:47.628 INFO:teuthology.orchestra.run.smithi089.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 3.8 MB/s | 197 kB 00:00 2023-12-19T13:30:47.653 INFO:teuthology.orchestra.run.smithi089.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2023-12-19T13:30:47.679 INFO:teuthology.orchestra.run.smithi089.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2023-12-19T13:30:47.704 INFO:teuthology.orchestra.run.smithi089.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2023-12-19T13:30:47.730 INFO:teuthology.orchestra.run.smithi089.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2023-12-19T13:30:47.735 INFO:teuthology.orchestra.run.smithi006.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 17 MB/s | 5.7 MB 00:00 2023-12-19T13:30:47.754 INFO:teuthology.orchestra.run.smithi089.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2023-12-19T13:30:47.760 INFO:teuthology.orchestra.run.smithi006.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 232 kB/s | 78 kB 00:00 2023-12-19T13:30:47.788 INFO:teuthology.orchestra.run.smithi089.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 155 kB/s | 9.0 kB 00:00 2023-12-19T13:30:47.813 INFO:teuthology.orchestra.run.smithi089.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2023-12-19T13:30:47.864 INFO:teuthology.orchestra.run.smithi089.stdout:(120/154): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2023-12-19T13:30:47.889 INFO:teuthology.orchestra.run.smithi089.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2023-12-19T13:30:47.914 INFO:teuthology.orchestra.run.smithi089.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-12-19T13:30:47.940 INFO:teuthology.orchestra.run.smithi089.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-19T13:30:47.965 INFO:teuthology.orchestra.run.smithi089.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-12-19T13:30:47.999 INFO:teuthology.orchestra.run.smithi089.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2023-12-19T13:30:48.024 INFO:teuthology.orchestra.run.smithi089.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2023-12-19T13:30:48.049 INFO:teuthology.orchestra.run.smithi089.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2023-12-19T13:30:48.075 INFO:teuthology.orchestra.run.smithi089.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2023-12-19T13:30:48.077 INFO:teuthology.orchestra.run.smithi006.stdout:(64/154): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-19T13:30:48.102 INFO:teuthology.orchestra.run.smithi006.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 668 kB/s | 228 kB 00:00 2023-12-19T13:30:48.117 INFO:teuthology.orchestra.run.smithi089.stdout:(129/154): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2023-12-19T13:30:48.119 INFO:teuthology.orchestra.run.smithi006.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 590 kB/s | 24 kB 00:00 2023-12-19T13:30:48.136 INFO:teuthology.orchestra.run.smithi006.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 540 kB/s | 18 kB 00:00 2023-12-19T13:30:48.150 INFO:teuthology.orchestra.run.smithi089.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2023-12-19T13:30:48.176 INFO:teuthology.orchestra.run.smithi089.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2023-12-19T13:30:48.178 INFO:teuthology.orchestra.run.smithi006.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-12-19T13:30:48.195 INFO:teuthology.orchestra.run.smithi006.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 538 kB/s | 32 kB 00:00 2023-12-19T13:30:48.201 INFO:teuthology.orchestra.run.smithi089.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-19T13:30:48.208 INFO:teuthology.orchestra.run.smithi144.stdout:(10/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 16 MB/s | 40 MB 00:02 2023-12-19T13:30:48.226 INFO:teuthology.orchestra.run.smithi089.stdout:(133/154): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-12-19T13:30:48.260 INFO:teuthology.orchestra.run.smithi089.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-12-19T13:30:48.294 INFO:teuthology.orchestra.run.smithi089.stdout:(135/154): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2023-12-19T13:30:48.311 INFO:teuthology.orchestra.run.smithi089.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 395 kB/s | 20 kB 00:00 2023-12-19T13:30:48.336 INFO:teuthology.orchestra.run.smithi089.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2023-12-19T13:30:48.366 INFO:teuthology.orchestra.run.smithi144.stdout:(11/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el 2.5 MB/s | 7.7 MB 00:03 2023-12-19T13:30:48.400 INFO:teuthology.orchestra.run.smithi144.stdout:(12/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.1 MB/s | 219 kB 00:00 2023-12-19T13:30:48.411 INFO:teuthology.orchestra.run.smithi089.stdout:(138/154): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2023-12-19T13:30:48.477 INFO:teuthology.orchestra.run.smithi144.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 407 kB/s | 31 kB 00:00 2023-12-19T13:30:48.509 INFO:teuthology.orchestra.run.smithi144.stdout:(14/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 191 kB/s | 27 kB 00:00 2023-12-19T13:30:48.559 INFO:teuthology.orchestra.run.smithi144.stdout:(15/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 8.0 MB/s | 658 kB 00:00 2023-12-19T13:30:48.562 INFO:teuthology.orchestra.run.smithi006.stdout:(70/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 4.8 MB 00:00 2023-12-19T13:30:48.588 INFO:teuthology.orchestra.run.smithi006.stdout:(71/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 555 kB/s | 217 kB 00:00 2023-12-19T13:30:48.617 INFO:teuthology.orchestra.run.smithi144.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 2.2 MB/s | 127 kB 00:00 2023-12-19T13:30:48.621 INFO:teuthology.orchestra.run.smithi006.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2023-12-19T13:30:48.655 INFO:teuthology.orchestra.run.smithi006.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 616 kB/s | 41 kB 00:00 2023-12-19T13:30:48.688 INFO:teuthology.orchestra.run.smithi006.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-12-19T13:30:48.730 INFO:teuthology.orchestra.run.smithi006.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-12-19T13:30:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:(139/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 8.4 MB/s | 3.0 MB 00:00 2023-12-19T13:30:48.830 INFO:teuthology.orchestra.run.smithi006.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 333 kB/s | 47 kB 00:00 2023-12-19T13:30:48.837 INFO:teuthology.orchestra.run.smithi089.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2023-12-19T13:30:48.855 INFO:teuthology.orchestra.run.smithi006.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 341 kB/s | 43 kB 00:00 2023-12-19T13:30:48.879 INFO:teuthology.orchestra.run.smithi089.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-19T13:30:48.885 INFO:teuthology.orchestra.run.smithi144.stdout:(17/154): ceph-common-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 18 MB 00:15 2023-12-19T13:30:48.914 INFO:teuthology.orchestra.run.smithi006.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 665 kB/s | 39 kB 00:00 2023-12-19T13:30:48.918 INFO:teuthology.orchestra.run.smithi144.stdout:(18/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 405 kB/s | 166 kB 00:00 2023-12-19T13:30:48.946 INFO:teuthology.orchestra.run.smithi089.stdout:(142/154): librados2-18.2.0-1377.g24e2e32a.el9. 5.4 MB/s | 3.3 MB 00:00 2023-12-19T13:30:48.960 INFO:teuthology.orchestra.run.smithi144.stdout:(19/154): libradosstriper1-18.2.0-1377.g24e2e32 1.4 MB/s | 474 kB 00:00 2023-12-19T13:30:48.971 INFO:teuthology.orchestra.run.smithi089.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 397 kB/s | 36 kB 00:00 2023-12-19T13:30:49.010 INFO:teuthology.orchestra.run.smithi144.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 2.5 MB/s | 124 kB 00:00 2023-12-19T13:30:49.052 INFO:teuthology.orchestra.run.smithi144.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 3.9 MB/s | 162 kB 00:00 2023-12-19T13:30:49.105 INFO:teuthology.orchestra.run.smithi089.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 1.2 MB/s | 192 kB 00:00 2023-12-19T13:30:49.111 INFO:teuthology.orchestra.run.smithi144.stdout:(22/154): python3-rados-18.2.0-1377.g24e2e32a.e 5.4 MB/s | 319 kB 00:00 2023-12-19T13:30:49.130 INFO:teuthology.orchestra.run.smithi089.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 1.6 MB/s | 255 kB 00:00 2023-12-19T13:30:49.180 INFO:teuthology.orchestra.run.smithi089.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 440 kB/s | 22 kB 00:00 2023-12-19T13:30:49.204 INFO:teuthology.orchestra.run.smithi144.stdout:(23/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 3.2 MB/s | 297 kB 00:00 2023-12-19T13:30:49.206 INFO:teuthology.orchestra.run.smithi089.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2023-12-19T13:30:49.253 INFO:teuthology.orchestra.run.smithi144.stdout:(24/154): python3-ceph-argparse-18.2.0-1377.g24 135 kB/s | 45 kB 00:00 2023-12-19T13:30:49.273 INFO:teuthology.orchestra.run.smithi006.stdout:(79/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 115 kB/s | 41 kB 00:00 2023-12-19T13:30:49.287 INFO:teuthology.orchestra.run.smithi144.stdout:(25/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 99 kB 00:00 2023-12-19T13:30:49.387 INFO:teuthology.orchestra.run.smithi144.stdout:(26/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 653 kB/s | 87 kB 00:00 2023-12-19T13:30:49.541 INFO:teuthology.orchestra.run.smithi144.stdout:(27/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 12 MB/s | 3.0 MB 00:00 2023-12-19T13:30:49.596 INFO:teuthology.orchestra.run.smithi144.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 430 kB/s | 23 kB 00:00 2023-12-19T13:30:49.621 INFO:teuthology.orchestra.run.smithi144.stdout:(29/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 734 kB/s | 171 kB 00:00 2023-12-19T13:30:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:(30/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 2.2 MB/s | 132 kB 00:00 2023-12-19T13:30:49.690 INFO:teuthology.orchestra.run.smithi006.stdout:(80/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2023-12-19T13:30:49.715 INFO:teuthology.orchestra.run.smithi006.stdout:(81/154): socat-1.7.4.1-5.el9.x86_64.rpm 682 kB/s | 300 kB 00:00 2023-12-19T13:30:49.740 INFO:teuthology.orchestra.run.smithi006.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-19T13:30:49.757 INFO:teuthology.orchestra.run.smithi006.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.0 MB/s | 85 kB 00:00 2023-12-19T13:30:49.783 INFO:teuthology.orchestra.run.smithi006.stdout:(84/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-19T13:30:49.808 INFO:teuthology.orchestra.run.smithi006.stdout:(85/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2023-12-19T13:30:49.813 INFO:teuthology.orchestra.run.smithi144.stdout:(31/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 4.8 MB/s | 4.5 MB 00:00 2023-12-19T13:30:49.833 INFO:teuthology.orchestra.run.smithi006.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-19T13:30:49.875 INFO:teuthology.orchestra.run.smithi006.stdout:(87/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-19T13:30:49.900 INFO:teuthology.orchestra.run.smithi006.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-19T13:30:49.914 INFO:teuthology.orchestra.run.smithi144.stdout:(32/154): ceph-mgr-modules-core-18.2.0-1377.g24 2.4 MB/s | 242 kB 00:00 2023-12-19T13:30:49.926 INFO:teuthology.orchestra.run.smithi006.stdout:(89/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-19T13:30:49.964 INFO:teuthology.orchestra.run.smithi144.stdout:(33/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 1.0 MB/s | 50 kB 00:00 2023-12-19T13:30:49.984 INFO:teuthology.orchestra.run.smithi006.stdout:(90/154): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-19T13:30:49.989 INFO:teuthology.orchestra.run.smithi089.stdout:(148/154): openssl-devel-3.0.7-25.el9.x86_64.rp 1.3 MB/s | 4.1 MB 00:03 2023-12-19T13:30:50.009 INFO:teuthology.orchestra.run.smithi006.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-12-19T13:30:50.014 INFO:teuthology.orchestra.run.smithi144.stdout:(34/154): ceph-prometheus-alerts-18.2.0-1377.g2 299 kB/s | 15 kB 00:00 2023-12-19T13:30:50.035 INFO:teuthology.orchestra.run.smithi006.stdout:(92/154): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-19T13:30:50.039 INFO:teuthology.orchestra.run.smithi089.stdout:(149/154): NetworkManager-libnm-1.45.7-1.el9.x8 2.1 MB/s | 1.8 MB 00:00 2023-12-19T13:30:50.060 INFO:teuthology.orchestra.run.smithi006.stdout:(93/154): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-19T13:30:50.086 INFO:teuthology.orchestra.run.smithi006.stdout:(94/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-19T13:30:50.098 INFO:teuthology.orchestra.run.smithi089.stdout:(150/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2023-12-19T13:30:50.149 INFO:teuthology.orchestra.run.smithi089.stdout:(151/154): NetworkManager-tui-1.45.7-1.el9.x86_ 2.2 MB/s | 246 kB 00:00 2023-12-19T13:30:50.156 INFO:teuthology.orchestra.run.smithi144.stdout:(35/154): ceph-mgr-diskprediction-local-18.2.0- 15 MB/s | 7.4 MB 00:00 2023-12-19T13:30:50.190 INFO:teuthology.orchestra.run.smithi144.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.5 MB/s | 262 kB 00:00 2023-12-19T13:30:50.240 INFO:teuthology.orchestra.run.smithi089.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 8.5 MB/s | 1.2 MB 00:00 2023-12-19T13:30:50.248 INFO:teuthology.orchestra.run.smithi144.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 2.4 MB/s | 221 kB 00:00 2023-12-19T13:30:50.274 INFO:teuthology.orchestra.run.smithi144.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 219 kB/s | 18 kB 00:00 2023-12-19T13:30:50.366 INFO:teuthology.orchestra.run.smithi089.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 9.9 MB/s | 2.2 MB 00:00 2023-12-19T13:30:50.391 INFO:teuthology.orchestra.run.smithi089.stdout:(154/154): NetworkManager-team-1.45.7-1.el9.x86 108 kB/s | 43 kB 00:00 2023-12-19T13:30:50.395 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:30:50.395 INFO:teuthology.orchestra.run.smithi089.stdout:Total 9.1 MB/s | 200 MB 00:21 2023-12-19T13:30:50.508 INFO:teuthology.orchestra.run.smithi144.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 662 kB 00:00 2023-12-19T13:30:50.564 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-19T13:30:50.594 INFO:teuthology.orchestra.run.smithi144.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 920 kB 00:00 2023-12-19T13:30:50.594 INFO:teuthology.orchestra.run.smithi006.stdout:(95/154): python3-devel-3.9.17-2.el9.x86_64.rpm 483 kB/s | 245 kB 00:00 2023-12-19T13:30:50.752 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-19T13:30:50.753 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-19T13:30:50.775 INFO:teuthology.orchestra.run.smithi144.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 404 kB/s | 106 kB 00:00 2023-12-19T13:30:50.800 INFO:teuthology.orchestra.run.smithi144.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 106 kB/s | 21 kB 00:00 2023-12-19T13:30:50.834 INFO:teuthology.orchestra.run.smithi144.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-19T13:30:50.859 INFO:teuthology.orchestra.run.smithi144.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 574 kB/s | 32 kB 00:00 2023-12-19T13:30:50.984 INFO:teuthology.orchestra.run.smithi144.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2023-12-19T13:30:51.009 INFO:teuthology.orchestra.run.smithi144.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 120 kB/s | 17 kB 00:00 2023-12-19T13:30:51.060 INFO:teuthology.orchestra.run.smithi144.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 3.7 MB/s | 186 kB 00:00 2023-12-19T13:30:51.086 INFO:teuthology.orchestra.run.smithi144.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 136 kB/s | 10 kB 00:00 2023-12-19T13:30:51.119 INFO:teuthology.orchestra.run.smithi144.stdout:(49/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 44 kB 00:00 2023-12-19T13:30:51.144 INFO:teuthology.orchestra.run.smithi144.stdout:(50/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-12-19T13:30:51.145 INFO:teuthology.orchestra.run.smithi006.stdout:(96/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 899 kB/s | 18 MB 00:20 2023-12-19T13:30:51.170 INFO:teuthology.orchestra.run.smithi006.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 193 kB/s | 111 kB 00:00 2023-12-19T13:30:51.203 INFO:teuthology.orchestra.run.smithi144.stdout:(51/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 1.1 MB/s | 1.8 MB 00:01 2023-12-19T13:30:51.228 INFO:teuthology.orchestra.run.smithi006.stdout:(98/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.5 MB/s | 4.1 MB 00:01 2023-12-19T13:30:51.236 INFO:teuthology.orchestra.run.smithi144.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 661 kB 00:00 2023-12-19T13:30:51.295 INFO:teuthology.orchestra.run.smithi144.stdout:(53/154): libtool-2.4.6-45.el9.x86_64.rpm 3.9 MB/s | 578 kB 00:00 2023-12-19T13:30:51.320 INFO:teuthology.orchestra.run.smithi144.stdout:(54/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 314 kB/s | 24 kB 00:00 2023-12-19T13:30:51.345 INFO:teuthology.orchestra.run.smithi144.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 451 kB/s | 46 kB 00:00 2023-12-19T13:30:51.379 INFO:teuthology.orchestra.run.smithi144.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2023-12-19T13:30:51.412 INFO:teuthology.orchestra.run.smithi144.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.4 MB/s | 217 kB 00:00 2023-12-19T13:30:51.438 INFO:teuthology.orchestra.run.smithi144.stdout:(58/154): openblas-0.3.21-2.el9.x86_64.rpm 387 kB/s | 34 kB 00:00 2023-12-19T13:30:51.617 INFO:teuthology.orchestra.run.smithi144.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-12-19T13:30:51.637 INFO:teuthology.orchestra.run.smithi006.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 68 kB/s | 26 kB 00:00 2023-12-19T13:30:51.672 INFO:teuthology.orchestra.run.smithi144.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 7.2 MB/s | 1.5 MB 00:00 2023-12-19T13:30:51.713 INFO:teuthology.orchestra.run.smithi144.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.1 MB/s | 811 kB 00:00 2023-12-19T13:30:51.738 INFO:teuthology.orchestra.run.smithi144.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-12-19T13:30:51.755 INFO:teuthology.orchestra.run.smithi144.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2023-12-19T13:30:51.829 INFO:teuthology.orchestra.run.smithi006.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 254 kB/s | 49 kB 00:00 2023-12-19T13:30:51.937 INFO:teuthology.orchestra.run.smithi006.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 623 kB/s | 67 kB 00:00 2023-12-19T13:30:51.951 INFO:teuthology.orchestra.run.smithi144.stdout:(64/154): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2023-12-19T13:30:52.063 INFO:teuthology.orchestra.run.smithi006.stdout:(102/154): gperftools-libs-2.9.1-2.el9.x86_64.r 336 kB/s | 309 kB 00:00 2023-12-19T13:30:52.090 INFO:teuthology.orchestra.run.smithi144.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-19T13:30:52.115 INFO:teuthology.orchestra.run.smithi144.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 670 kB/s | 228 kB 00:00 2023-12-19T13:30:52.140 INFO:teuthology.orchestra.run.smithi144.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 138 kB/s | 24 kB 00:00 2023-12-19T13:30:52.182 INFO:teuthology.orchestra.run.smithi144.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 449 kB/s | 18 kB 00:00 2023-12-19T13:30:52.205 INFO:teuthology.orchestra.run.smithi006.stdout:(103/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2023-12-19T13:30:52.207 INFO:teuthology.orchestra.run.smithi144.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 485 kB/s | 32 kB 00:00 2023-12-19T13:30:52.249 INFO:teuthology.orchestra.run.smithi144.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-12-19T13:30:52.278 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-19T13:30:52.280 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-19T13:30:52.305 INFO:teuthology.orchestra.run.smithi006.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 436 kB/s | 43 kB 00:00 2023-12-19T13:30:52.366 INFO:teuthology.orchestra.run.smithi144.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-19T13:30:52.391 INFO:teuthology.orchestra.run.smithi144.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2023-12-19T13:30:52.405 INFO:teuthology.orchestra.run.smithi006.stdout:(105/154): libarrow-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2023-12-19T13:30:52.407 INFO:teuthology.orchestra.run.smithi144.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-12-19T13:30:52.422 INFO:teuthology.orchestra.run.smithi006.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2023-12-19T13:30:52.450 INFO:teuthology.orchestra.run.smithi144.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-12-19T13:30:52.475 INFO:teuthology.orchestra.run.smithi144.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-12-19T13:30:52.500 INFO:teuthology.orchestra.run.smithi144.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-12-19T13:30:52.505 INFO:teuthology.orchestra.run.smithi006.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2023-12-19T13:30:52.525 INFO:teuthology.orchestra.run.smithi144.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 649 kB/s | 47 kB 00:00 2023-12-19T13:30:52.530 INFO:teuthology.orchestra.run.smithi006.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-12-19T13:30:52.567 INFO:teuthology.orchestra.run.smithi144.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 652 kB/s | 43 kB 00:00 2023-12-19T13:30:52.631 INFO:teuthology.orchestra.run.smithi006.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-12-19T13:30:52.681 INFO:teuthology.orchestra.run.smithi006.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2023-12-19T13:30:52.718 INFO:teuthology.orchestra.run.smithi144.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 202 kB/s | 39 kB 00:00 2023-12-19T13:30:52.756 INFO:teuthology.orchestra.run.smithi006.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2023-12-19T13:30:52.782 INFO:teuthology.orchestra.run.smithi006.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 1.9 MB/s | 197 kB 00:00 2023-12-19T13:30:52.807 INFO:teuthology.orchestra.run.smithi006.stdout:(113/154): python3-asyncssh-2.13.2-3.el9.noarch 736 kB/s | 548 kB 00:00 2023-12-19T13:30:52.857 INFO:teuthology.orchestra.run.smithi006.stdout:(114/154): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2023-12-19T13:30:52.883 INFO:teuthology.orchestra.run.smithi006.stdout:(115/154): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2023-12-19T13:30:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2023-12-19T13:30:52.926 INFO:teuthology.orchestra.run.smithi144.stdout:(80/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2023-12-19T13:30:52.952 INFO:teuthology.orchestra.run.smithi144.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 112 kB/s | 41 kB 00:00 2023-12-19T13:30:52.958 INFO:teuthology.orchestra.run.smithi006.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2023-12-19T13:30:52.984 INFO:teuthology.orchestra.run.smithi006.stdout:(118/154): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2023-12-19T13:30:53.002 INFO:teuthology.orchestra.run.smithi144.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-12-19T13:30:53.008 INFO:teuthology.orchestra.run.smithi006.stdout:(119/154): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-12-19T13:30:53.044 INFO:teuthology.orchestra.run.smithi144.stdout:(83/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-19T13:30:53.069 INFO:teuthology.orchestra.run.smithi144.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-12-19T13:30:53.074 INFO:teuthology.orchestra.run.smithi006.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 352 kB/s | 41 kB 00:00 2023-12-19T13:30:53.094 INFO:teuthology.orchestra.run.smithi144.stdout:(85/154): uuid-1.6.2-55.el9.x86_64.rpm 621 kB/s | 56 kB 00:00 2023-12-19T13:30:53.117 INFO:teuthology.orchestra.run.smithi006.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 427 kB/s | 46 kB 00:00 2023-12-19T13:30:53.119 INFO:teuthology.orchestra.run.smithi144.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 596 kB/s | 44 kB 00:00 2023-12-19T13:30:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-19T13:30:53.178 INFO:teuthology.orchestra.run.smithi144.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 195 kB 00:00 2023-12-19T13:30:53.193 INFO:teuthology.orchestra.run.smithi006.stdout:(122/154): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2023-12-19T13:30:53.218 INFO:teuthology.orchestra.run.smithi006.stdout:(123/154): python3-more-itertools-8.12.0-2.el9. 551 kB/s | 79 kB 00:00 2023-12-19T13:30:53.220 INFO:teuthology.orchestra.run.smithi144.stdout:(89/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2023-12-19T13:30:53.244 INFO:teuthology.orchestra.run.smithi006.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 458 kB/s | 58 kB 00:00 2023-12-19T13:30:53.245 INFO:teuthology.orchestra.run.smithi144.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-12-19T13:30:53.296 INFO:teuthology.orchestra.run.smithi144.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-19T13:30:53.302 INFO:teuthology.orchestra.run.smithi006.stdout:(125/154): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-12-19T13:30:53.327 INFO:teuthology.orchestra.run.smithi006.stdout:(126/154): python3-portend-3.1.0-2.el9.noarch.r 150 kB/s | 16 kB 00:00 2023-12-19T13:30:53.346 INFO:teuthology.orchestra.run.smithi144.stdout:(92/154): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2023-12-19T13:30:53.371 INFO:teuthology.orchestra.run.smithi144.stdout:(93/154): python3-ply-3.11-14.el9.noarch.rpm 898 kB/s | 103 kB 00:00 2023-12-19T13:30:53.396 INFO:teuthology.orchestra.run.smithi144.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-19T13:30:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2023-12-19T13:30:53.430 INFO:teuthology.orchestra.run.smithi144.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2023-12-19T13:30:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:(128/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 430 kB/s | 90 kB 00:00 2023-12-19T13:30:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 204 kB/s | 31 kB 00:00 2023-12-19T13:30:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-19T13:30:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2023-12-19T13:30:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2023-12-19T13:30:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2023-12-19T13:30:53.680 INFO:teuthology.orchestra.run.smithi006.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2023-12-19T13:30:53.705 INFO:teuthology.orchestra.run.smithi144.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 803 kB/s | 245 kB 00:00 2023-12-19T13:30:53.738 INFO:teuthology.orchestra.run.smithi006.stdout:(135/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2023-12-19T13:30:53.780 INFO:teuthology.orchestra.run.smithi006.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2023-12-19T13:30:53.822 INFO:teuthology.orchestra.run.smithi006.stdout:(137/154): python3-webob-1.8.7-6.el9.noarch.rpm 857 kB/s | 230 kB 00:00 2023-12-19T13:30:53.839 INFO:teuthology.orchestra.run.smithi144.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 272 kB/s | 111 kB 00:00 2023-12-19T13:30:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-12-19T13:30:54.214 INFO:teuthology.orchestra.run.smithi144.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 609 kB/s | 309 kB 00:00 2023-12-19T13:30:54.297 INFO:teuthology.orchestra.run.smithi006.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2023-12-19T13:30:54.339 INFO:teuthology.orchestra.run.smithi006.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-19T13:30:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:(99/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 4.3 MB/s | 4.1 MB 00:00 2023-12-19T13:30:54.381 INFO:teuthology.orchestra.run.smithi006.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-19T13:30:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:(100/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 149 kB/s | 26 kB 00:00 2023-12-19T13:30:54.423 INFO:teuthology.orchestra.run.smithi006.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 878 kB/s | 36 kB 00:00 2023-12-19T13:30:54.473 INFO:teuthology.orchestra.run.smithi006.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-12-19T13:30:54.524 INFO:teuthology.orchestra.run.smithi006.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-12-19T13:30:54.531 INFO:teuthology.orchestra.run.smithi144.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 478 kB/s | 67 kB 00:00 2023-12-19T13:30:54.582 INFO:teuthology.orchestra.run.smithi006.stdout:(145/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 4.1 MB/s | 3.0 MB 00:00 2023-12-19T13:30:54.608 INFO:teuthology.orchestra.run.smithi006.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 263 kB/s | 22 kB 00:00 2023-12-19T13:30:54.633 INFO:teuthology.orchestra.run.smithi006.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-19T13:30:54.712 INFO:teuthology.orchestra.run.smithi144.stdout:(102/154): liboath-2.6.7-2.el9.x86_64.rpm 138 kB/s | 49 kB 00:00 2023-12-19T13:30:55.065 INFO:teuthology.orchestra.run.smithi144.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 1.5 MB/s | 548 kB 00:00 2023-12-19T13:30:55.116 INFO:teuthology.orchestra.run.smithi144.stdout:(104/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.4 MB/s | 838 kB 00:00 2023-12-19T13:30:55.141 INFO:teuthology.orchestra.run.smithi144.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 580 kB/s | 43 kB 00:00 2023-12-19T13:30:55.158 INFO:teuthology.orchestra.run.smithi006.stdout:(148/154): NetworkManager-libnm-1.45.7-1.el9.x8 3.4 MB/s | 1.8 MB 00:00 2023-12-19T13:30:55.217 INFO:teuthology.orchestra.run.smithi006.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 744 kB/s | 43 kB 00:00 2023-12-19T13:30:55.233 INFO:teuthology.orchestra.run.smithi144.stdout:(106/154): libarrow-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2023-12-19T13:30:55.258 INFO:teuthology.orchestra.run.smithi144.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 129 kB/s | 15 kB 00:00 2023-12-19T13:30:55.275 INFO:teuthology.orchestra.run.smithi006.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 4.1 MB/s | 246 kB 00:00 2023-12-19T13:30:55.283 INFO:teuthology.orchestra.run.smithi144.stdout:(108/154): python3-cachetools-4.2.4-1.el9.noarc 193 kB/s | 32 kB 00:00 2023-12-19T13:30:55.317 INFO:teuthology.orchestra.run.smithi144.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-12-19T13:30:55.317 INFO:teuthology.orchestra.run.smithi006.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2023-12-19T13:30:55.417 INFO:teuthology.orchestra.run.smithi144.stdout:(110/154): python3-colorama-0.4.4-12.el9.noarch 355 kB/s | 35 kB 00:00 2023-12-19T13:30:55.443 INFO:teuthology.orchestra.run.smithi006.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2023-12-19T13:30:55.451 INFO:teuthology.orchestra.run.smithi144.stdout:(111/154): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2023-12-19T13:30:55.484 INFO:teuthology.orchestra.run.smithi144.stdout:(112/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2023-12-19T13:30:55.510 INFO:teuthology.orchestra.run.smithi144.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2023-12-19T13:30:55.544 INFO:teuthology.orchestra.run.smithi144.stdout:(114/154): python3-google-auth-2.23.4-1.el9.noa 1.5 MB/s | 197 kB 00:00 2023-12-19T13:30:55.569 INFO:teuthology.orchestra.run.smithi144.stdout:(115/154): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2023-12-19T13:30:55.594 INFO:teuthology.orchestra.run.smithi144.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 279 kB/s | 23 kB 00:00 2023-12-19T13:30:55.619 INFO:teuthology.orchestra.run.smithi144.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2023-12-19T13:30:55.653 INFO:teuthology.orchestra.run.smithi144.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 158 kB/s | 9.0 kB 00:00 2023-12-19T13:30:55.678 INFO:teuthology.orchestra.run.smithi144.stdout:(119/154): python3-jaraco-text-3.2.0-6.el9.noar 238 kB/s | 20 kB 00:00 2023-12-19T13:30:55.704 INFO:teuthology.orchestra.run.smithi144.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 490 kB/s | 41 kB 00:00 2023-12-19T13:30:55.743 INFO:teuthology.orchestra.run.smithi006.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.1 MB/s | 2.2 MB 00:00 2023-12-19T13:30:55.820 INFO:teuthology.orchestra.run.smithi144.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 327 kB/s | 46 kB 00:00 2023-12-19T13:30:55.846 INFO:teuthology.orchestra.run.smithi144.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 559 kB/s | 79 kB 00:00 2023-12-19T13:30:55.879 INFO:teuthology.orchestra.run.smithi144.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2023-12-19T13:30:55.938 INFO:teuthology.orchestra.run.smithi144.stdout:(124/154): python3-portend-3.1.0-2.el9.noarch.r 285 kB/s | 16 kB 00:00 2023-12-19T13:30:55.943 INFO:teuthology.orchestra.run.smithi006.stdout:(154/154): librados2-18.2.0-1377.g24e2e32a.el9. 1.5 MB/s | 3.3 MB 00:02 2023-12-19T13:30:55.950 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:30:55.950 INFO:teuthology.orchestra.run.smithi006.stdout:Total 7.3 MB/s | 200 MB 00:27 2023-12-19T13:30:55.988 INFO:teuthology.orchestra.run.smithi144.stdout:(125/154): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2023-12-19T13:30:56.022 INFO:teuthology.orchestra.run.smithi144.stdout:(126/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2023-12-19T13:30:56.047 INFO:teuthology.orchestra.run.smithi144.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 833 kB/s | 90 kB 00:00 2023-12-19T13:30:56.072 INFO:teuthology.orchestra.run.smithi144.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 340 kB/s | 28 kB 00:00 2023-12-19T13:30:56.098 INFO:teuthology.orchestra.run.smithi144.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2023-12-19T13:30:56.120 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-12-19T13:30:56.164 INFO:teuthology.orchestra.run.smithi144.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-12-19T13:30:56.190 INFO:teuthology.orchestra.run.smithi144.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 393 kB/s | 36 kB 00:00 2023-12-19T13:30:56.215 INFO:teuthology.orchestra.run.smithi144.stdout:(132/154): python3-rsa-4.9-2.el9.noarch.rpm 417 kB/s | 59 kB 00:00 2023-12-19T13:30:56.240 INFO:teuthology.orchestra.run.smithi144.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 684 kB/s | 51 kB 00:00 2023-12-19T13:30:56.274 INFO:teuthology.orchestra.run.smithi144.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-12-19T13:30:56.307 INFO:teuthology.orchestra.run.smithi144.stdout:(135/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-12-19T13:30:56.328 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-12-19T13:30:56.328 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-12-19T13:30:56.333 INFO:teuthology.orchestra.run.smithi144.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2023-12-19T13:30:56.366 INFO:teuthology.orchestra.run.smithi144.stdout:(137/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-12-19T13:30:56.425 INFO:teuthology.orchestra.run.smithi144.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-12-19T13:30:56.634 INFO:teuthology.orchestra.run.smithi144.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2023-12-19T13:30:56.726 INFO:teuthology.orchestra.run.smithi144.stdout:(140/154): librados2-18.2.0-1377.g24e2e32a.el9. 9.1 MB/s | 3.3 MB 00:00 2023-12-19T13:30:56.751 INFO:teuthology.orchestra.run.smithi144.stdout:(141/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 583 kB/s | 68 kB 00:00 2023-12-19T13:30:56.776 INFO:teuthology.orchestra.run.smithi144.stdout:(142/154): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-12-19T13:30:56.831 INFO:teuthology.orchestra.run.smithi144.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 464 kB/s | 36 kB 00:00 2023-12-19T13:30:56.868 INFO:teuthology.orchestra.run.smithi144.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 2.1 MB/s | 192 kB 00:00 2023-12-19T13:30:56.902 INFO:teuthology.orchestra.run.smithi144.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 3.7 MB/s | 255 kB 00:00 2023-12-19T13:30:56.927 INFO:teuthology.orchestra.run.smithi144.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 393 kB/s | 22 kB 00:00 2023-12-19T13:30:56.961 INFO:teuthology.orchestra.run.smithi144.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-12-19T13:30:57.236 INFO:teuthology.orchestra.run.smithi144.stdout:(148/154): NetworkManager-1.45.7-1.el9.x86_64.r 7.4 MB/s | 2.3 MB 00:00 2023-12-19T13:30:57.295 INFO:teuthology.orchestra.run.smithi144.stdout:(149/154): NetworkManager-libnm-1.45.7-1.el9.x8 5.3 MB/s | 1.8 MB 00:00 2023-12-19T13:30:57.320 INFO:teuthology.orchestra.run.smithi144.stdout:(150/154): NetworkManager-team-1.45.7-1.el9.x86 524 kB/s | 43 kB 00:00 2023-12-19T13:30:57.429 INFO:teuthology.orchestra.run.smithi144.stdout:(151/154): NetworkManager-tui-1.45.7-1.el9.x86_ 1.8 MB/s | 246 kB 00:00 2023-12-19T13:30:57.487 INFO:teuthology.orchestra.run.smithi144.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2023-12-19T13:30:57.571 INFO:teuthology.orchestra.run.smithi144.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 15 MB/s | 2.2 MB 00:00 2023-12-19T13:30:57.947 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-12-19T13:30:57.948 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-12-19T13:30:58.063 INFO:teuthology.orchestra.run.smithi144.stdout:(154/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 1.8 MB/s | 3.0 MB 00:01 2023-12-19T13:30:58.077 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:30:58.077 INFO:teuthology.orchestra.run.smithi144.stdout:Total 8.0 MB/s | 200 MB 00:25 2023-12-19T13:30:58.273 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-19T13:30:58.402 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T13:30:58.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T13:30:58.475 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T13:30:58.487 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-12-19T13:30:58.512 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T13:30:58.538 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T13:30:58.580 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T13:30:58.766 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-12-19T13:30:58.767 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-12-19T13:30:58.928 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T13:30:59.215 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:30:59.329 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:30:59.357 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:30:59.433 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:30:59.462 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:30:59.503 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T13:30:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T13:30:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T13:30:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:30:59.848 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:30:59.873 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:31:00.005 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:31:00.093 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:31:00.146 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:31:00.218 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:00.272 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:00.459 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:00.554 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T13:31:00.594 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T13:31:00.661 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T13:31:00.716 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T13:31:00.747 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T13:31:00.782 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T13:31:00.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T13:31:00.886 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T13:31:00.922 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T13:31:00.950 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T13:31:00.977 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-12-19T13:31:00.995 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-12-19T13:31:01.018 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T13:31:01.054 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T13:31:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T13:31:01.171 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T13:31:01.310 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T13:31:01.366 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T13:31:01.884 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T13:31:01.962 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T13:31:01.994 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T13:31:02.035 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T13:31:02.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T13:31:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T13:31:02.258 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T13:31:02.307 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T13:31:02.414 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T13:31:02.461 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T13:31:02.516 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T13:31:02.588 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T13:31:02.620 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T13:31:02.657 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T13:31:02.712 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T13:31:02.749 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T13:31:02.791 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T13:31:02.833 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T13:31:02.965 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T13:31:03.014 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T13:31:03.053 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T13:31:03.097 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T13:31:03.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T13:31:03.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T13:31:03.252 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T13:31:03.286 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T13:31:03.313 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T13:31:03.404 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T13:31:03.447 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T13:31:03.495 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T13:31:03.552 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T13:31:03.735 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T13:31:03.785 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T13:31:03.913 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T13:31:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T13:31:03.984 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T13:31:04.017 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T13:31:04.050 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T13:31:04.090 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T13:31:04.117 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T13:31:04.152 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T13:31:04.191 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T13:31:04.222 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T13:31:04.236 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-12-19T13:31:04.252 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T13:31:04.329 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T13:31:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T13:31:04.363 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T13:31:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T13:31:04.396 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T13:31:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T13:31:04.438 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T13:31:04.456 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T13:31:04.472 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T13:31:04.490 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T13:31:04.532 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T13:31:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T13:31:04.600 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T13:31:04.702 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T13:31:04.751 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T13:31:04.860 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T13:31:04.924 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:31:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:31:05.067 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:31:05.159 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:31:05.188 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:31:05.226 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T13:31:05.401 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T13:31:05.453 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T13:31:05.471 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T13:31:05.480 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:31:05.526 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T13:31:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:31:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:31:05.646 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T13:31:05.706 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:31:05.825 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T13:31:05.826 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:31:05.887 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:31:05.956 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:05.996 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:06.051 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T13:31:06.092 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T13:31:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:06.270 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T13:31:06.299 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T13:31:06.299 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T13:31:06.334 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T13:31:06.375 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T13:31:06.406 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T13:31:06.458 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T13:31:06.487 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T13:31:06.523 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T13:31:06.563 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T13:31:06.629 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T13:31:06.662 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T13:31:06.698 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T13:31:06.778 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T13:31:06.811 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T13:31:06.855 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T13:31:06.931 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T13:31:07.021 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T13:31:07.069 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T13:31:07.124 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T13:31:07.146 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T13:31:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-12-19T13:31:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T13:31:07.772 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T13:31:07.808 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T13:31:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T13:31:07.849 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T13:31:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T13:31:07.887 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T13:31:07.962 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T13:31:07.992 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T13:31:08.058 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T13:31:08.088 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T13:31:08.190 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T13:31:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T13:31:08.361 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T13:31:08.437 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T13:31:08.443 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T13:31:08.474 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T13:31:08.505 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T13:31:08.534 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T13:31:08.547 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T13:31:08.567 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T13:31:08.582 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T13:31:08.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T13:31:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T13:31:08.686 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:31:08.711 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T13:31:08.741 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T13:31:08.778 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T13:31:08.825 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T13:31:08.840 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:31:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T13:31:08.866 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T13:31:08.870 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:31:08.898 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:31:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T13:31:08.945 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T13:31:08.987 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:31:08.994 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:31:09.019 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T13:31:09.042 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:31:09.055 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T13:31:09.086 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T13:31:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T13:31:09.134 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T13:31:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T13:31:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T13:31:09.294 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T13:31:09.339 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T13:31:09.379 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T13:31:09.400 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T13:31:09.404 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T13:31:09.431 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T13:31:09.454 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T13:31:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T13:31:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:31:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:31:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T13:31:09.538 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:31:09.561 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T13:31:09.583 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T13:31:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:31:09.632 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T13:31:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:31:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T13:31:09.879 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T13:31:09.920 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T13:31:09.969 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T13:31:10.063 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T13:31:10.106 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T13:31:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T13:31:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T13:31:10.197 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:31:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T13:31:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T13:31:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T13:31:10.285 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T13:31:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T13:31:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T13:31:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T13:31:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T13:31:10.469 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T13:31:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T13:31:10.525 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T13:31:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T13:31:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T13:31:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T13:31:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T13:31:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T13:31:10.867 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T13:31:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T13:31:11.039 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T13:31:11.081 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T13:31:11.200 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T13:31:11.280 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T13:31:11.318 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T13:31:11.401 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T13:31:11.466 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T13:31:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T13:31:11.601 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:11.629 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T13:31:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:11.662 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T13:31:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T13:31:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T13:31:11.782 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T13:31:11.809 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T13:31:11.830 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T13:31:11.851 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T13:31:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T13:31:11.921 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T13:31:11.958 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T13:31:12.006 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T13:31:12.141 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T13:31:12.176 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:12.180 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T13:31:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T13:31:12.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:31:12.259 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T13:31:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T13:31:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:31:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T13:31:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T13:31:12.306 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:12.329 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:31:12.940 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T13:31:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T13:31:13.055 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T13:31:13.076 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T13:31:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T13:31:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T13:31:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T13:31:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T13:31:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T13:31:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T13:31:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T13:31:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T13:31:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T13:31:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T13:31:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T13:31:14.290 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T13:31:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T13:31:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T13:31:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T13:31:14.456 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T13:31:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T13:31:14.486 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T13:31:14.518 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T13:31:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T13:31:14.548 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T13:31:14.579 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T13:31:14.740 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T13:31:14.804 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T13:31:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T13:31:14.895 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T13:31:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T13:31:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:31:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:31:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T13:31:15.055 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T13:31:15.083 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T13:31:15.102 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T13:31:15.163 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T13:31:15.208 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T13:31:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T13:31:15.413 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T13:31:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T13:31:15.508 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T13:31:15.553 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:31:15.572 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T13:31:15.616 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:31:15.647 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T13:31:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T13:31:15.923 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T13:31:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T13:31:16.160 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T13:31:16.235 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T13:31:16.260 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T13:31:16.301 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T13:31:16.343 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T13:31:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T13:31:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T13:31:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T13:31:16.590 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T13:31:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T13:31:16.708 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T13:31:16.846 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T13:31:16.902 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T13:31:16.945 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T13:31:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T13:31:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T13:31:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T13:31:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T13:31:17.391 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T13:31:17.467 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T13:31:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:18.309 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:18.347 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:31:18.431 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:31:18.431 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T13:31:18.431 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T13:31:18.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T13:31:18.464 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:31:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T13:31:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T13:31:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T13:31:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T13:31:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T13:31:18.988 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T13:31:19.023 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T13:31:19.118 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T13:31:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T13:31:20.068 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T13:31:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T13:31:21.753 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T13:31:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T13:31:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T13:31:21.866 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T13:31:21.907 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T13:31:22.272 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T13:31:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:31:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T13:31:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T13:31:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T13:31:23.010 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T13:31:23.072 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:31:23.156 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T13:31:23.182 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T13:31:23.914 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-12-19T13:31:23.915 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:24.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:31:24.090 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:31:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T13:31:24.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:25.637 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:25.644 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:31:25.669 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:31:25.669 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:25.670 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T13:31:25.670 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:31:25.670 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:31:25.670 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:25.687 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:25.870 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:31:25.893 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:31:25.893 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:25.893 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T13:31:25.893 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:31:25.893 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:31:25.893 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T13:31:26.337 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:31:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:31:26.359 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:31:26.360 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:26.360 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T13:31:26.360 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:31:26.360 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:31:26.360 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:26.447 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T13:31:26.519 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T13:31:26.520 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T13:31:26.520 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T13:31:26.520 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:26.566 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:31:26.818 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:31:26.838 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:31:26.866 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T13:31:26.920 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T13:31:26.945 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:31:27.165 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:31:27.195 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:31:28.163 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:31:28.187 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:31:28.287 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:31:28.436 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T13:31:28.465 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:31:28.487 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:31:28.487 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:28.488 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T13:31:28.488 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:31:28.488 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:31:28.488 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:28.532 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:31:28.543 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:31:28.589 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T13:31:29.294 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T13:31:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:31:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:31:29.348 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:29.348 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T13:31:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:31:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:31:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:29.385 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:31:29.407 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:31:29.407 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:29.407 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T13:31:29.407 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:29.452 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:31:29.475 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:31:29.475 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:29.475 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T13:31:29.475 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:31:29.476 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:31:29.476 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:29.770 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:31:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:31:29.792 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:29.792 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T13:31:29.792 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:31:29.792 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:31:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-12-19T13:31:30.312 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:30.476 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:31:30.492 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:31:30.492 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:30.492 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T13:31:30.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:31:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:31:32.140 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:32.140 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T13:31:32.140 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:31:32.140 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:31:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:31:32.387 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:31:32.387 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:32.387 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T13:31:32.387 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:31:32.387 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:31:32.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:32.864 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:31:32.887 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:31:32.887 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:32.887 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T13:31:32.888 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:31:32.888 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:31:32.888 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:33.041 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T13:31:33.380 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:31:33.406 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:31:33.435 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T13:31:33.491 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T13:31:33.500 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T13:31:33.528 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:31:33.540 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T13:31:33.581 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T13:31:33.613 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T13:31:33.640 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T13:31:33.765 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:31:33.805 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:31:33.819 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T13:31:33.937 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T13:31:33.971 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T13:31:34.004 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T13:31:34.065 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T13:31:34.111 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:31:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T13:31:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T13:31:34.223 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T13:31:34.826 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:31:34.847 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:31:34.873 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:34.915 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:34.935 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:34.954 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:31:35.119 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T13:31:35.148 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:31:35.172 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:31:35.172 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:35.172 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T13:31:35.172 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:31:35.173 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:31:35.173 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:35.216 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:31:35.227 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:31:35.273 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T13:31:35.753 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T13:31:35.847 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T13:31:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T13:31:35.928 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T13:31:36.009 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T13:31:36.023 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T13:31:36.042 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T13:31:36.051 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:31:36.067 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T13:31:36.075 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:31:36.075 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:36.075 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T13:31:36.075 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:31:36.075 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:31:36.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:36.092 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T13:31:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:31:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T13:31:36.119 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:31:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:31:36.141 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:36.141 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T13:31:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:31:36.195 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:31:36.209 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:31:36.209 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:36.209 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T13:31:36.209 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:31:36.209 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:31:36.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:36.223 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T13:31:36.253 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T13:31:36.279 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T13:31:36.279 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:31:36.363 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:31:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:31:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:36.386 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:36.520 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:31:36.543 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:31:36.543 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:36.543 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T13:31:36.543 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:31:36.543 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:31:36.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:36.566 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:36.566 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:36.667 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:36.691 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T13:31:36.717 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T13:31:36.742 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T13:31:36.807 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-12-19T13:31:39.146 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2023-12-19T13:31:39.147 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-12-19T13:31:39.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:39.373 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:31:39.421 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T13:31:39.421 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:39.421 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T13:31:39.422 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:40.507 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T13:31:40.549 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T13:31:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T13:31:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T13:31:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T13:31:40.828 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T13:31:40.941 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T13:31:40.971 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T13:31:41.004 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T13:31:41.060 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T13:31:41.103 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:31:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T13:31:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T13:31:41.183 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T13:31:41.184 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T13:31:41.185 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T13:31:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T13:31:41.197 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T13:31:41.197 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T13:31:41.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T13:31:41.199 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T13:31:41.200 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T13:31:41.201 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T13:31:41.202 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T13:31:41.203 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T13:31:41.204 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T13:31:41.205 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T13:31:41.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T13:31:41.207 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T13:31:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T13:31:41.257 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T13:31:41.258 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:41.258 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T13:31:41.258 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:31:41.258 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T13:31:41.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:41.527 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:31:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T13:31:41.606 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:41.606 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T13:31:41.606 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:31:41.606 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T13:31:41.606 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:41.889 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:41.929 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:31:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T13:31:42.191 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:42.191 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T13:31:42.191 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:31:42.192 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T13:31:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T13:31:42.822 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T13:31:42.838 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:31:42.906 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T13:31:42.909 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T13:31:42.961 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T13:31:42.966 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T13:31:43.009 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T13:31:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T13:31:43.092 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T13:31:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:31:43.129 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T13:31:43.154 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T13:31:43.179 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T13:31:43.206 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T13:31:43.206 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:31:43.290 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:31:43.318 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T13:31:43.357 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T13:31:43.382 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T13:31:43.382 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:31:43.432 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T13:31:43.467 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:31:43.476 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:31:43.492 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:31:43.498 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:43.498 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:43.667 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T13:31:43.667 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.668 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.669 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.670 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-16.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T13:31:43.671 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T13:31:43.672 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T13:31:43.673 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T13:31:43.674 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T13:31:43.675 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T13:31:43.676 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T13:31:43.677 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T13:31:43.678 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T13:31:43.679 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T13:31:43.679 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:31:43.679 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-19T13:31:43.686 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:43.686 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:43.770 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:43.794 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T13:31:43.819 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T13:31:43.845 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T13:31:43.911 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:31:44.226 DEBUG:teuthology.parallel:result is None 2023-12-19T13:31:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T13:31:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:31:44.795 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T13:31:44.967 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T13:31:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:31:45.088 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T13:31:45.088 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:45.088 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T13:31:45.088 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:31:45.088 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T13:31:45.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:45.146 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:31:45.189 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T13:31:45.267 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T13:31:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T13:31:46.123 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:31:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T13:31:46.205 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:46.205 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T13:31:46.205 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:31:46.205 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T13:31:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:31:46.339 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T13:31:46.339 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:46.339 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T13:31:46.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:46.417 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:31:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T13:31:46.495 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:46.495 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T13:31:46.495 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:31:46.495 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T13:31:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:46.875 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:31:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T13:31:46.947 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T13:31:46.947 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T13:31:46.947 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:31:46.947 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T13:31:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:31:48.397 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:31:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T13:31:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T13:31:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T13:31:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T13:31:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T13:31:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T13:31:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T13:31:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T13:31:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T13:31:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T13:31:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T13:31:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T13:31:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T13:31:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:31:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T13:31:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T13:31:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T13:31:50.952 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T13:31:50.953 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.954 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T13:31:50.955 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-16.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.956 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T13:31:50.957 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T13:31:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T13:31:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T13:31:50.960 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T13:31:50.961 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T13:31:50.962 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T13:31:50.963 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T13:31:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T13:31:50.964 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T13:31:50.964 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:31:50.964 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-12-19T13:31:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T13:31:51.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T13:31:51.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T13:31:51.134 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T13:31:51.455 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T13:31:51.458 DEBUG:teuthology.parallel:result is None 2023-12-19T13:31:51.610 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T13:31:51.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T13:31:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T13:31:51.789 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T13:31:51.884 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:31:51.929 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T13:31:51.982 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T13:31:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T13:31:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T13:31:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T13:31:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T13:31:54.695 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T13:31:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T13:31:55.441 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T13:31:55.486 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T13:31:55.544 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T13:31:55.578 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T13:31:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T13:31:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:31:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T13:31:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T13:31:55.883 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T13:31:55.915 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T13:31:55.915 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:31:56.044 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T13:31:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:31:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T13:31:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:56.641 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:31:56.677 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T13:31:56.711 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T13:31:56.745 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T13:31:56.880 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:31:57.147 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T13:31:57.147 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T13:31:57.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:01.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T13:32:01.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T13:32:01.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T13:32:01.455 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T13:32:01.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T13:32:01.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T13:32:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T13:32:01.459 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T13:32:01.460 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T13:32:01.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T13:32:01.462 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T13:32:01.463 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T13:32:01.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T13:32:01.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T13:32:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T13:32:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:03.846 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-12-19T13:32:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T13:32:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T13:32:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-16.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T13:32:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T13:32:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T13:32:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T13:32:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T13:32:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T13:32:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T13:32:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T13:32:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T13:32:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T13:32:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T13:32:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T13:32:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T13:32:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:03.859 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-12-19T13:32:04.508 DEBUG:teuthology.parallel:result is None 2023-12-19T13:32:04.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:32:04.779 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T13:32:04.805 INFO:teuthology.orchestra.run.smithi006.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T13:32:04.806 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T13:32:04.806 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T13:32:04.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:32:04.948 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T13:32:04.973 INFO:teuthology.orchestra.run.smithi089.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T13:32:04.973 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T13:32:04.973 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T13:32:04.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T13:32:05.188 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T13:32:05.244 INFO:teuthology.orchestra.run.smithi144.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T13:32:05.244 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T13:32:05.244 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T13:32:05.246 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T13:32:05.246 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:05.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T13:32:05.285 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:05.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T13:32:05.319 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:05.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T13:32:05.398 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T13:32:05.398 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:05.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T13:32:05.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T13:32:05.508 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:05.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T13:32:05.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T13:32:05.604 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:05.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T13:32:05.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T13:32:05.803 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T13:32:05.804 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:05.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T13:32:05.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T13:32:05.905 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:05.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T13:32:05.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T13:32:06.000 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:06.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T13:32:06.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T13:32:06.224 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T13:32:06.225 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:06.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T13:32:06.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T13:32:06.325 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:06.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T13:32:06.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T13:32:06.417 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:06.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T13:32:06.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T13:32:06.633 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T13:32:06.702 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T13:32:06.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-12-19T13:32:06.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-12-19T13:32:06.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-12-19T13:32:06.800 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T13:32:06.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T13:32:06.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T13:32:06.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T13:32:06.881 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T13:32:06.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T13:32:06.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T13:32:06.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T13:32:06.961 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T13:32:06.962 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T13:32:06.962 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T13:32:06.962 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:06.962 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T13:32:06.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:07.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:07.136 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:07.136 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T13:32:07.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:07.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:07.294 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:07.294 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T13:32:07.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:07.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:07.638 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T13:32:07.638 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T13:32:07.639 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': None, 'first_in_suite': False, 'job_id': '7496743', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdsdD00jk52f4SWwlcJkgBPxt6Hn8KZrl/wOFbZYoGWzRuWx2g+4x7d6HAh86IW3vRDLEs1ebQbL6QuOfledIM=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKggtyj6U7Gk0UCx1j07DqC5wBpV9T8wtNedcMCOSHXgw2q3m3rvhpWBpbR+BZw4t/0H2ia/LAGk4XTjX0I9rxs=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9HyulgJ5+WUTJbHQmdc6OtfTBq6eIKRbLsXZgrQ5P2uOwJpnxE+Q3WFa8r6914xk9yv3FleqXShjQ4DzdSSMY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_11:42:11', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T13:32:07.639 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T13:32:07.641 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T13:32:07.644 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T13:32:07.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T13:32:07.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T13:32:07.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T13:32:07.800 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:07.800 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T13:32:07.816 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T13:32:07.816 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-12-19T13:32:07.871 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-12-19 13:31:44.242845868 +0000 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-12-19 13:25:46.666618067 +0000 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-12-19 13:25:46.666618067 +0000 2023-12-19T13:32:07.872 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-12-19 13:25:46.666618067 +0000 2023-12-19T13:32:07.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T13:32:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-12-19T13:32:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-12-19T13:32:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000206279 s, 2.5 MB/s 2023-12-19T13:32:07.943 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T13:32:08.001 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 680 Links: 1 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-12-19 13:31:44.242845868 +0000 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-12-19 13:25:47.150613282 +0000 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-12-19 13:25:47.150613282 +0000 2023-12-19T13:32:08.057 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-12-19 13:25:47.150613282 +0000 2023-12-19T13:32:08.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T13:32:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-12-19T13:32:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-12-19T13:32:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000228803 s, 2.2 MB/s 2023-12-19T13:32:08.129 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T13:32:08.186 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-12-19T13:32:08.241 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-12-19 13:31:44.242845868 +0000 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-12-19 13:25:47.641608428 +0000 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-12-19 13:25:47.641608428 +0000 2023-12-19T13:32:08.242 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-12-19 13:25:47.641608428 +0000 2023-12-19T13:32:08.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T13:32:08.311 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-12-19T13:32:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-12-19T13:32:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000303464 s, 1.7 MB/s 2023-12-19T13:32:08.313 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T13:32:08.369 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 718 Links: 1 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-12-19 13:31:44.242845868 +0000 2023-12-19T13:32:08.424 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-12-19 13:25:48.127603624 +0000 2023-12-19T13:32:08.425 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-12-19 13:25:48.127603624 +0000 2023-12-19T13:32:08.425 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-12-19 13:25:48.127603624 +0000 2023-12-19T13:32:08.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T13:32:08.493 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-12-19T13:32:08.493 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-12-19T13:32:08.493 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000211581 s, 2.4 MB/s 2023-12-19T13:32:08.494 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T13:32:08.551 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:08.551 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:08.551 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T13:32:08.568 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T13:32:08.568 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-19 13:31:37.115500153 +0000 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-19 13:25:36.894591166 +0000 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-19 13:25:36.894591166 +0000 2023-12-19T13:32:08.624 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-19 13:25:36.894591166 +0000 2023-12-19T13:32:08.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T13:32:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-19T13:32:08.691 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-19T13:32:08.692 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000203268 s, 2.5 MB/s 2023-12-19T13:32:08.693 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T13:32:08.749 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-12-19T13:32:08.804 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T13:32:08.804 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:08.804 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-19T13:32:08.804 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:08.805 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:08.805 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-19 13:31:37.115500153 +0000 2023-12-19T13:32:08.805 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-19 13:25:37.391579753 +0000 2023-12-19T13:32:08.805 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-19 13:25:37.391579753 +0000 2023-12-19T13:32:08.805 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-19 13:25:37.391579753 +0000 2023-12-19T13:32:08.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T13:32:08.870 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-19T13:32:08.871 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-19T13:32:08.871 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000211547 s, 2.4 MB/s 2023-12-19T13:32:08.872 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T13:32:08.927 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-19 13:31:37.116500131 +0000 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-19 13:25:37.876568615 +0000 2023-12-19T13:32:08.982 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-19 13:25:37.876568615 +0000 2023-12-19T13:32:08.983 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-19 13:25:37.876568615 +0000 2023-12-19T13:32:08.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T13:32:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-19T13:32:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-19T13:32:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000207868 s, 2.5 MB/s 2023-12-19T13:32:09.049 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T13:32:09.105 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-12-19T13:32:09.160 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T13:32:09.160 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T13:32:09.160 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 718 Links: 1 2023-12-19T13:32:09.160 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T13:32:09.160 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T13:32:09.161 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-19 13:31:37.116500131 +0000 2023-12-19T13:32:09.161 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-19 13:25:38.363557431 +0000 2023-12-19T13:32:09.161 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-19 13:25:38.363557431 +0000 2023-12-19T13:32:09.161 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-19 13:25:38.363557431 +0000 2023-12-19T13:32:09.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T13:32:09.225 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-19T13:32:09.225 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-19T13:32:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000190674 s, 2.7 MB/s 2023-12-19T13:32:09.226 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T13:32:09.282 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:09.282 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T13:32:09.282 INFO:tasks.ceph:Generating config... 2023-12-19T13:32:09.284 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T13:32:09.284 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T13:32:09.284 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T13:32:09.284 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T13:32:09.284 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T13:32:09.284 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T13:32:09.284 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T13:32:09.285 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T13:32:09.285 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T13:32:09.285 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T13:32:09.285 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T13:32:09.285 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T13:32:09.285 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T13:32:09.286 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T13:32:09.286 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T13:32:09.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T13:32:09.345 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T13:32:09.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T13:32:09.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:32:09.429 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-12-19T13:32:09.430 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T13:32:09.430 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:09.430 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T13:32:09.485 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:09.569 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid dcbd1077-757f-4b91-a6c2-c01c60d71a4f 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:fsid dcbd1077-757f-4b91-a6c2-c01c60d71a4f 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-12-19T13:32:09.568751+0000 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-12-19T13:32:09.568751+0000 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 16 (pacific) 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-12-19T13:32:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T13:32:09.571 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T13:32:09.586 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dcbd1077-757f-4b91-a6c2-c01c60d71a4f... 2023-12-19T13:32:09.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T13:32:09.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T13:32:09.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.680 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-12-19T13:32:09.681 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-12-19T13:32:09.682 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.6,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn min per osd = 0 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = dcbd1077-757f-4b91-a6c2-c01c60d71a4f 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-12-19T13:32:09.683 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-12-19T13:32:09.684 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-12-19T13:32:09.686 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-12-19T13:32:09.687 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T13:32:09.687 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-12-19T13:32:09.687 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-12-19T13:32:09.687 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-12-19T13:32:09.687 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-12-19T13:32:09.687 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-12-19T13:32:09.688 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:32:09.689 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-12-19T13:32:09.690 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-12-19T13:32:09.691 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-12-19T13:32:09.692 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.693 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-12-19T13:32:09.694 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-12-19T13:32:09.695 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn min per osd = 0 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = dcbd1077-757f-4b91-a6c2-c01c60d71a4f 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-12-19T13:32:09.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-12-19T13:32:09.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2023-12-19T13:32:09.698 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:32:09.699 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-12-19T13:32:09.701 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-12-19T13:32:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-12-19T13:32:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-12-19T13:32:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T13:32:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-12-19T13:32:09.801 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-12-19T13:32:09.802 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.6,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn min per osd = 0 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = dcbd1077-757f-4b91-a6c2-c01c60d71a4f 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.803 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.804 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2023-12-19T13:32:09.805 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-12-19T13:32:09.806 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-12-19T13:32:09.807 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:32:09.808 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-12-19T13:32:09.809 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-12-19T13:32:09.810 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-12-19T13:32:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-12-19T13:32:09.840 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T13:32:09.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T13:32:09.900 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T13:32:09.900 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:09.901 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T13:32:09.915 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:09.915 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T13:32:09.970 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T13:32:09.970 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:09.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T13:32:09.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:32:10.056 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:10.056 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:10.111 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T13:32:10.111 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:10.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T13:32:10.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:32:10.151 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:10.152 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:10.206 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-12-19T13:32:10.207 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:10.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T13:32:10.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T13:32:10.365 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:10.365 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:10.466 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T13:32:10.466 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T13:32:10.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T13:32:10.529 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T13:32:10.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T13:32:10.599 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T13:32:10.602 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T13:32:10.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T13:32:10.663 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T13:32:10.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T13:32:10.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T13:32:10.798 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T13:32:10.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T13:32:10.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T13:32:10.885 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T13:32:10.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T13:32:10.913 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T13:32:10.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T13:32:11.054 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T13:32:11.115 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T13:32:11.115 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T13:32:11.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T13:32:11.147 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:11.147 INFO:tasks.ceph:role: osd.0 2023-12-19T13:32:11.147 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T13:32:11.147 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T13:32:11.226 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:11.227 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:11.733 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-12-19T13:32:11.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-12-19T13:32:11.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T13:32:11.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T13:32:11.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T13:32:11.974 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:11.975 INFO:tasks.ceph:role: osd.1 2023-12-19T13:32:11.975 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T13:32:11.975 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T13:32:12.054 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:12.055 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:12.497 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-12-19T13:32:12.500 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-12-19T13:32:12.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T13:32:12.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T13:32:12.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T13:32:12.712 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:12.712 INFO:tasks.ceph:role: osd.2 2023-12-19T13:32:12.712 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T13:32:12.712 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:12.793 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:12.794 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:12.794 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:12.794 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:13.301 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-12-19T13:32:13.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-12-19T13:32:13.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T13:32:13.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T13:32:13.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T13:32:13.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:13.540 INFO:tasks.ceph:role: osd.3 2023-12-19T13:32:13.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T13:32:13.540 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:13.621 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:14.106 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-12-19T13:32:14.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-12-19T13:32:14.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T13:32:14.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T13:32:14.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:14.370+0000 7fe022b9b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T13:32:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:14.370+0000 7fe022b9b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T13:32:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:14.370+0000 7fe022b9b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T13:32:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:14.370+0000 7fe022b9b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T13:32:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:14.370+0000 7fe022b9b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T13:32:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:14.371+0000 7fe022b9b500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T13:32:17.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T13:32:17.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:17.367+0000 7f154938b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T13:32:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:17.367+0000 7f154938b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T13:32:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:17.367+0000 7f154938b500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T13:32:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:17.367+0000 7f154938b500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T13:32:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:17.367+0000 7f154938b500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T13:32:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:17.367+0000 7f154938b500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T13:32:20.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T13:32:20.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:20.357+0000 7f1731a22500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T13:32:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:20.357+0000 7f1731a22500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T13:32:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:20.357+0000 7f1731a22500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T13:32:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:20.357+0000 7f1731a22500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T13:32:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:20.357+0000 7f1731a22500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T13:32:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:20.358+0000 7f1731a22500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T13:32:23.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T13:32:23.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:23.336+0000 7f230560d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T13:32:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:23.336+0000 7f230560d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T13:32:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:23.336+0000 7f230560d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T13:32:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:23.336+0000 7f230560d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T13:32:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:23.336+0000 7f230560d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T13:32:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:23.337+0000 7f230560d500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T13:32:26.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T13:32:26.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T13:32:26.262 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:26.262 INFO:tasks.ceph:role: osd.4 2023-12-19T13:32:26.262 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T13:32:26.262 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:26.340 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:26.830 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-19T13:32:26.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-19T13:32:26.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T13:32:26.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T13:32:26.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T13:32:27.059 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:27.059 INFO:tasks.ceph:role: osd.5 2023-12-19T13:32:27.059 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T13:32:27.060 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T13:32:27.134 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:27.134 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:27.134 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:27.134 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:27.135 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:27.135 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:27.135 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:27.135 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:27.135 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:27.135 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:27.589 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-19T13:32:27.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-19T13:32:27.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T13:32:27.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T13:32:27.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T13:32:27.776 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:27.776 INFO:tasks.ceph:role: osd.6 2023-12-19T13:32:27.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T13:32:27.776 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:27.850 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:28.347 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-19T13:32:28.349 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-19T13:32:28.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T13:32:28.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T13:32:28.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T13:32:28.582 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T13:32:28.582 INFO:tasks.ceph:role: osd.7 2023-12-19T13:32:28.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T13:32:28.582 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T13:32:28.656 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T13:32:28.657 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T13:32:28.657 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T13:32:29.158 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-19T13:32:29.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-19T13:32:29.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T13:32:29.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T13:32:29.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:29.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:29.395+0000 7f0701acd500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T13:32:29.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:29.395+0000 7f0701acd500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T13:32:29.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:29.395+0000 7f0701acd500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T13:32:29.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:29.395+0000 7f0701acd500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T13:32:29.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:29.395+0000 7f0701acd500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T13:32:29.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:29.396+0000 7f0701acd500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T13:32:32.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T13:32:32.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:32.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:32.363+0000 7f76d549a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T13:32:32.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:32.363+0000 7f76d549a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T13:32:32.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:32.363+0000 7f76d549a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T13:32:32.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:32.363+0000 7f76d549a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T13:32:32.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:32.363+0000 7f76d549a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T13:32:32.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:32.364+0000 7f76d549a500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T13:32:35.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T13:32:35.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:35.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:35.328+0000 7faf74469500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T13:32:35.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:35.329+0000 7faf74469500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T13:32:35.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:35.329+0000 7faf74469500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T13:32:35.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:35.329+0000 7faf74469500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T13:32:35.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:35.329+0000 7faf74469500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T13:32:35.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:35.329+0000 7faf74469500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T13:32:37.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:37.643 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:37.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:38.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T13:32:38.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:38.307+0000 7f995eed6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T13:32:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:38.307+0000 7f995eed6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T13:32:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:38.307+0000 7f995eed6500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T13:32:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:38.307+0000 7f995eed6500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T13:32:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:38.307+0000 7f995eed6500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T13:32:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:38.308+0000 7f995eed6500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T13:32:41.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T13:32:41.189 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T13:32:41.189 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T13:32:41.225 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T13:32:41.299 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T13:32:41.372 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T13:32:41.445 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T13:32:41.518 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T13:32:41.590 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:41.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T13:32:41.662 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:41.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T13:32:41.694 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:41.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T13:32:41.765 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:41.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T13:32:41.835 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:41.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T13:32:41.904 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:41.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T13:32:41.972 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:41.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T13:32:42.041 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:32:42.041 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T13:32:42.099 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T13:32:42.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T13:32:42.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T13:32:42.128 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-12-19T13:32:42.128 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBam4Fl7Y6BHxAAEAne9NwNJlJ9q3gvvu6NFA== 2023-12-19T13:32:42.128 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-12-19T13:32:42.128 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBam4FlUyiCJxAAHxiXo1cJj88C99BHaptcjA== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBam4Flwy+CLxAAKW1EEmQKEEl9FmV298Tf0g== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBem4FlCq4lFhAA/D6TRlsnXU/8a3EuZ6V+zg== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBhm4FlSSTxFRAAK7DaJ847voiGgCKTM2uIuA== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBkm4FlQltdFRAAyTVGePcQ5hFbEKGLiysVwA== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBnm4FlwVogFBAAdjFTdBHmhp013VUppwd0zA== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBam4FlwMqrIxAABWSyozd2+1/fHBhKuykVNQ== 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-12-19T13:32:42.129 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBam4FlFwG2NBAAuX9czzxSB8oBNxY+UsyL3A== 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBtm4FlXmejFxAA439Qwc2e2bQ1HUyUb8WWwQ== 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBwm4FlmzuxFRAA9jlmMXWne9YbBG6F0LBzMw== 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBzm4Fl//CdExAAcEwl0BmEIfFinQaBsqU0sA== 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQB2m4FlintYEhAAP6SPI15p9gZJH9q/3oMnHQ== 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-19T13:32:42.130 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBbm4FlAdIsAxAAufEa2ozXomX8m2NUoIgckg== 2023-12-19T13:32:42.133 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBam4Fl7Y6BHxAAEAne9NwNJlJ9q3gvvu6NFA== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBam4FlUyiCJxAAHxiXo1cJj88C99BHaptcjA== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBam4Flwy+CLxAAKW1EEmQKEEl9FmV298Tf0g== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBem4FlCq4lFhAA/D6TRlsnXU/8a3EuZ6V+zg== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBhm4FlSSTxFRAAK7DaJ847voiGgCKTM2uIuA== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBkm4FlQltdFRAAyTVGePcQ5hFbEKGLiysVwA== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBnm4FlwVogFBAAdjFTdBHmhp013VUppwd0zA== 2023-12-19T13:32:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBam4FlwMqrIxAABWSyozd2+1/fHBhKuykVNQ== 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBam4FlFwG2NBAAuX9czzxSB8oBNxY+UsyL3A== 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBtm4FlXmejFxAA439Qwc2e2bQ1HUyUb8WWwQ== 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBwm4FlmzuxFRAA9jlmMXWne9YbBG6F0LBzMw== 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBzm4Fl//CdExAAcEwl0BmEIfFinQaBsqU0sA== 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB2m4FlintYEhAAP6SPI15p9gZJH9q/3oMnHQ== 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-12-19T13:32:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBbm4FlAdIsAxAAufEa2ozXomX8m2NUoIgckg== 2023-12-19T13:32:42.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:32:42.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:32:42.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:32:42.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:32:42.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:32:42.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:32:42.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.525 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:32:42.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T13:32:42.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:32:42.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T13:32:42.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T13:32:42.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:32:42.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T13:32:42.970 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T13:32:42.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T13:32:43.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T13:32:43.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T13:32:43.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T13:32:43.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T13:32:43.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T13:32:43.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T13:32:43.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T13:32:43.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T13:32:43.471 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:43.473 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T13:32:43.525 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T13:32:43.526 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T13:32:43.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T13:32:43.529 INFO:tasks.ceph.mon.a:Started 2023-12-19T13:32:43.529 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T13:32:43.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T13:32:43.567 INFO:tasks.ceph.mon.b:Started 2023-12-19T13:32:43.568 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T13:32:43.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T13:32:43.569 INFO:tasks.ceph.mon.c:Started 2023-12-19T13:32:43.570 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T13:32:43.570 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T13:32:43.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T13:32:43.572 INFO:tasks.ceph.mgr.y:Started 2023-12-19T13:32:43.572 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T13:32:43.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T13:32:43.574 INFO:tasks.ceph.mgr.x:Started 2023-12-19T13:32:43.574 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T13:32:43.574 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T13:32:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.680+0000 7faeb3f88640 1 Processor -- start 2023-12-19T13:32:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.680+0000 7faeb3f88640 1 -- start start 2023-12-19T13:32:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.680+0000 7faeb3f88640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7faeac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.680+0000 7faeb3f88640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac070630 con 0x7faeac14ee10 2023-12-19T13:32:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.680+0000 7faeb3f88640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac070070 con 0x7faeac0b0a40 2023-12-19T13:32:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.680+0000 7faeb3f88640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac070350 con 0x7faeac144e40 2023-12-19T13:32:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb2525640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faeac14ee10 0x7faeac1554d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58042/0 (socket says 172.21.15.6:58042) 2023-12-19T13:32:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb2525640 1 -- 172.21.15.6:0/701246542 learned_addr learned my addr 172.21.15.6:0/701246542 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:32:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb1d24640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7faeac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb1d24640 1 -- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 msgr2=0x7faeac06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T13:32:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb1d24640 1 -- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 msgr2=0x7faeac06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T13:32:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb1d24640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7faeac06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T13:32:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.681+0000 7faeb1d24640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7faeac06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T13:32:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.870+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340239002 0 0) 0x7faeac070630 con 0x7faeac14ee10 2023-12-19T13:32:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.870+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae98003520 con 0x7faeac14ee10 2023-12-19T13:32:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133854294 0 0) 0x7fae98003520 con 0x7faeac14ee10 2023-12-19T13:32:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 msgr2=0x7faeac06d680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7faeac06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 >> v1:172.21.15.89:6789/0 conn(0x7faeac0b0a40 legacy=0x7faeac14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac14e1e0 con 0x7faeac14ee10 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7faea40019f0 con 0x7faeac14ee10 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 >> v1:172.21.15.6:6789/0 conn(0x7faeac14ee10 legacy=0x7faeac1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae980039a0 0x7fae98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7fae980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac070350 con 0x7fae98004d00 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9800bb10 con 0x7fae980039a0 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.871+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9800bca0 con 0x7faeac144e40 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1d24640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae980039a0 0x7fae98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb2525640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1523640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7fae980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1523640 1 -- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae980039a0 msgr2=0x7fae98003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1523640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae980039a0 0x7fae98003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1523640 1 -- 172.21.15.6:0/701246542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae98004d00 msgr2=0x7fae98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1523640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1523640 1 -- 172.21.15.6:0/701246542 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98003520 con 0x7faeac144e40 2023-12-19T13:32:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.872+0000 7faeb1d24640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae980039a0 0x7fae98003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.873+0000 7faeb1523640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7fae980047c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae9c001780 tx=0x7fae980057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bc146c10d3f3d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0052d0 con 0x7faeac144e40 2023-12-19T13:32:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c02e050 con 0x7faeac144e40 2023-12-19T13:32:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb0d22640 1 -- 172.21.15.6:0/701246542 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0035f0 con 0x7faeac144e40 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb3f88640 1 -- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 msgr2=0x7fae980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb3f88640 1 --2- 172.21.15.6:0/701246542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac144e40 0x7fae980047c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae9c001780 tx=0x7fae980057f0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb2525640 1 -- 172.21.15.6:0/701246542 reap_dead start 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb3f88640 1 -- 172.21.15.6:0/701246542 shutdown_connections 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.875+0000 7faeb3f88640 1 -- 172.21.15.6:0/701246542 >> 172.21.15.6:0/701246542 conn(0x7faeac06ae10 msgr2=0x7faeac06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.876+0000 7faeb3f88640 1 -- 172.21.15.6:0/701246542 shutdown_connections 2023-12-19T13:32:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.876+0000 7faeb3f88640 1 -- 172.21.15.6:0/701246542 wait complete. 2023-12-19T13:32:43.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.877+0000 7faeb3f88640 1 Processor -- start 2023-12-19T13:32:43.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.877+0000 7faeb3f88640 1 -- start start 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb3f88640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac144e40 0x7faeac0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb3f88640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac147f30 0x7faeac0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb3f88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 0x7faeac143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb3f88640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b61b0 con 0x7faeac0b1360 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb3f88640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac147810 con 0x7faeac144e40 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb3f88640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1483b0 con 0x7faeac147f30 2023-12-19T13:32:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 0x7faeac143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 0x7faeac143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39298/0 (socket says 172.21.15.6:39298) 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 -- 172.21.15.6:0/1037650596 learned_addr learned my addr 172.21.15.6:0/1037650596 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb1523640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac147f30 0x7faeac0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb1d24640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac144e40 0x7faeac0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 -- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac147f30 msgr2=0x7faeac0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac147f30 0x7faeac0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 -- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac144e40 msgr2=0x7faeac0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac144e40 0x7faeac0b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 -- 172.21.15.6:0/1037650596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac147530 con 0x7faeac0b1360 2023-12-19T13:32:43.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faeb2525640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 0x7faeac143c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faea4000f80 tx=0x7faea400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4007af0 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea40133f0 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.878+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4013780 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.879+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0b3350 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.879+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0b3b50 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.879+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faea4013be0 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.879+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faea401bc40 con 0x7faeac0b1360 2023-12-19T13:32:43.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.879+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac0b3870 con 0x7faeac0b1360 2023-12-19T13:32:43.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.882+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7faeac0b3870 con 0x7faeac0b1360 2023-12-19T13:32:43.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.948+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7faeac0bc370 con 0x7faeac0b1360 2023-12-19T13:32:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.951+0000 7faea27fc640 1 -- 172.21.15.6:0/1037650596 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7faea402b020 con 0x7faeac0b1360 2023-12-19T13:32:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 msgr2=0x7faeac143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 0x7faeac143c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faea4000f80 tx=0x7faea400a6e0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 shutdown_connections 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeac0b1360 0x7faeac143c50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeac147f30 0x7faeac0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 --2- 172.21.15.6:0/1037650596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac144e40 0x7faeac0b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 >> 172.21.15.6:0/1037650596 conn(0x7faeac06ae10 msgr2=0x7faeac06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 shutdown_connections 2023-12-19T13:32:43.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:43.952+0000 7faeb3f88640 1 -- 172.21.15.6:0/1037650596 wait complete. 2023-12-19T13:32:43.965 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T13:32:43.965 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T13:32:43.965 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:43.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T13:32:43.996 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:43.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T13:32:44.066 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:44.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T13:32:44.136 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-12-19T13:32:44.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T13:32:44.206 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:44.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T13:32:44.233 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:44.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T13:32:44.300 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:44.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T13:32:44.311 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:44.309+0000 7f2d3aa17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T13:32:44.320 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:44.318+0000 7fd220a2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T13:32:44.337 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-19T13:32:44.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T13:32:44.365 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:44.362+0000 7f2d3aa17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T13:32:44.374 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:44.372+0000 7fd220a2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T13:32:44.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 7572066e-c130-4b07-a454-1c5f0f9ebaa9 0 2023-12-19T13:32:44.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.528+0000 7fa7a0270640 1 Processor -- start 2023-12-19T13:32:44.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.528+0000 7fa7a0270640 1 -- start start 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa7a0270640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa79806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa7a0270640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7980b7410 0x7fa7980ba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa7a0270640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7980b7cd0 0x7fa7980b8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa7a0270640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7980bbf00 con 0x7fa7980b7cd0 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa7a0270640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7980ba5d0 con 0x7fa7980b7410 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa7a0270640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa798072130 con 0x7fa798065c10 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa79806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79d80b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7980b7410 0x7fa7980ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa79806a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40796/0 (socket says 172.21.15.89:40796) 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 -- 172.21.15.89:0/934388673 learned_addr learned my addr 172.21.15.89:0/934388673 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e80d640 1 --2- 172.21.15.89:0/934388673 >> v2:172.21.15.6:3300/0 conn(0x7fa7980b7cd0 0x7fa7980b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 -- 172.21.15.89:0/934388673 >> v2:172.21.15.89:3300/0 conn(0x7fa7980b7410 msgr2=0x7fa7980ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 --2- 172.21.15.89:0/934388673 >> v2:172.21.15.89:3300/0 conn(0x7fa7980b7410 0x7fa7980ba800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 -- 172.21.15.89:0/934388673 >> v2:172.21.15.6:3300/0 conn(0x7fa7980b7cd0 msgr2=0x7fa7980b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 --2- 172.21.15.89:0/934388673 >> v2:172.21.15.6:3300/0 conn(0x7fa7980b7cd0 0x7fa7980b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79e00c640 1 -- 172.21.15.89:0/934388673 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79806a3b0 con 0x7fa798065c10 2023-12-19T13:32:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.529+0000 7fa79d80b640 1 --2- 172.21.15.89:0/934388673 >> v2:172.21.15.89:3300/0 conn(0x7fa7980b7410 0x7fa7980ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.530+0000 7fa79e00c640 1 --2- 172.21.15.89:0/934388673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa79806a8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa798066290 tx=0x7fa78802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff860119ef5077c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.530+0000 7fa79d00a640 1 -- 172.21.15.89:0/934388673 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7880317e0 con 0x7fa798065c10 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.530+0000 7fa79d00a640 1 -- 172.21.15.89:0/934388673 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788031940 con 0x7fa798065c10 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.530+0000 7fa79d00a640 1 -- 172.21.15.89:0/934388673 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788031cd0 con 0x7fa798065c10 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 -- 172.21.15.89:0/934388673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 msgr2=0x7fa79806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 --2- 172.21.15.89:0/934388673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa79806a8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa798066290 tx=0x7fa78802b880 comp rx=0 tx=0).stop 2023-12-19T13:32:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 -- 172.21.15.89:0/934388673 shutdown_connections 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 --2- 172.21.15.89:0/934388673 >> v2:172.21.15.6:3300/0 conn(0x7fa7980b7cd0 0x7fa7980b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 --2- 172.21.15.89:0/934388673 >> v2:172.21.15.89:3300/0 conn(0x7fa7980b7410 0x7fa7980ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 --2- 172.21.15.89:0/934388673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa79806a8d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 -- 172.21.15.89:0/934388673 >> 172.21.15.89:0/934388673 conn(0x7fa7980b9250 msgr2=0x7fa7980b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 -- 172.21.15.89:0/934388673 shutdown_connections 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.531+0000 7fa7a0270640 1 -- 172.21.15.89:0/934388673 wait complete. 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 Processor -- start 2023-12-19T13:32:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 -- start start 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa7981e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7980b7410 0x7fa798099bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7980b7cd0 0x7fa7981d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7981d6040 con 0x7fa7980b7410 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7981d6210 con 0x7fa7980b7cd0 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.532+0000 7fa7a0270640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7981e0120 con 0x7fa798065c10 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa7981e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa7981e0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40800/0 (socket says 172.21.15.89:40800) 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 -- 172.21.15.89:0/3734645937 learned_addr learned my addr 172.21.15.89:0/3734645937 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e80d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7980b7cd0 0x7fa7981d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79d80b640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7980b7410 0x7fa798099bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 -- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7980b7cd0 msgr2=0x7fa7981d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7980b7cd0 0x7fa7981d5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 -- 172.21.15.89:0/3734645937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7980b7410 msgr2=0x7fa798099bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7980b7410 0x7fa798099bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 -- 172.21.15.89:0/3734645937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009400 con 0x7fa798065c10 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa79e00c640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa7981e0c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa788000c00 tx=0x7fa7880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788032880 con 0x7fa798065c10 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788032a20 con 0x7fa798065c10 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7880094d0 con 0x7fa798065c10 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788032dd0 con 0x7fa798065c10 2023-12-19T13:32:44.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7981e06e0 con 0x7fa798065c10 2023-12-19T13:32:44.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.533+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa78804e750 con 0x7fa798065c10 2023-12-19T13:32:44.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.534+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa7880455b0 con 0x7fa798065c10 2023-12-19T13:32:44.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.534+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa798073a40 con 0x7fa798065c10 2023-12-19T13:32:44.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.536+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fa78802e070 con 0x7fa798065c10 2023-12-19T13:32:44.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.607+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7572066e-c130-4b07-a454-1c5f0f9ebaa9", "id": 0} v 0) v1 -- 0x7fa7980a0890 con 0x7fa798065c10 2023-12-19T13:32:44.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.610+0000 7fa78effd640 1 -- 172.21.15.89:0/3734645937 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7572066e-c130-4b07-a454-1c5f0f9ebaa9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa78804eb90 con 0x7fa798065c10 2023-12-19T13:32:44.612 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-12-19T13:32:44.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 msgr2=0x7fa7981e0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa7981e0c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa788000c00 tx=0x7fa7880046c0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 shutdown_connections 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7980b7cd0 0x7fa7981d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7980b7410 0x7fa798099bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 --2- 172.21.15.89:0/3734645937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa798065c10 0x7fa7981e0c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 >> 172.21.15.89:0/3734645937 conn(0x7fa7980b9250 msgr2=0x7fa7981d4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 shutdown_connections 2023-12-19T13:32:44.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.611+0000 7fa7a0270640 1 -- 172.21.15.89:0/3734645937 wait complete. 2023-12-19T13:32:44.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 3c314916-8775-4069-b8a8-b98969fb7138 1 2023-12-19T13:32:44.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.720+0000 7fc59879f640 1 Processor -- start 2023-12-19T13:32:44.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.720+0000 7fc59879f640 1 -- start start 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59879f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc590144e40 0x7fc59006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59879f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59014ee10 0x7fc5901554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59879f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc590070630 con 0x7fc5900b0a40 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59879f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc590070070 con 0x7fc590144e40 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59879f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc590070350 con 0x7fc59014ee10 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc590144e40 0x7fc59006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc596d3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59014ee10 0x7fc5901554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc590144e40 0x7fc59006d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39858/0 (socket says 172.21.15.89:39858) 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc595d3a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc5900b0a40 0x7fc59014e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47044/0 (socket says 172.21.15.89:47044) 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 -- 172.21.15.89:0/3048747060 learned_addr learned my addr 172.21.15.89:0/3048747060 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 -- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59014ee10 msgr2=0x7fc5901554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 --2- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59014ee10 0x7fc5901554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 -- 172.21.15.89:0/3048747060 >> v1:172.21.15.89:6789/0 conn(0x7fc5900b0a40 legacy=0x7fc59014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc59653b640 1 -- 172.21.15.89:0/3048747060 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59014e1e0 con 0x7fc590144e40 2023-12-19T13:32:44.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc595539640 1 -- 172.21.15.89:0/3048747060 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449526660 0 0) 0x7fc590070630 con 0x7fc5900b0a40 2023-12-19T13:32:44.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.721+0000 7fc596d3c640 1 --2- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59014ee10 0x7fc5901554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.722+0000 7fc59653b640 1 --2- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590144e40 0x7fc59006d680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009870 tx=0x7fc58c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6386362872840f8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.722+0000 7fc595539640 1 -- 172.21.15.89:0/3048747060 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c030840 con 0x7fc590144e40 2023-12-19T13:32:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.722+0000 7fc595539640 1 -- 172.21.15.89:0/3048747060 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0309a0 con 0x7fc590144e40 2023-12-19T13:32:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.722+0000 7fc595539640 1 -- 172.21.15.89:0/3048747060 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c030d30 con 0x7fc590144e40 2023-12-19T13:32:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 -- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590144e40 msgr2=0x7fc59006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 --2- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590144e40 0x7fc59006d680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009870 tx=0x7fc58c02b980 comp rx=0 tx=0).stop 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 -- 172.21.15.89:0/3048747060 shutdown_connections 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 --2- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59014ee10 0x7fc5901554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 --2- 172.21.15.89:0/3048747060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc590144e40 0x7fc59006d680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 -- 172.21.15.89:0/3048747060 >> 172.21.15.89:0/3048747060 conn(0x7fc59006ae10 msgr2=0x7fc59006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 -- 172.21.15.89:0/3048747060 shutdown_connections 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.723+0000 7fc59879f640 1 -- 172.21.15.89:0/3048747060 wait complete. 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 Processor -- start 2023-12-19T13:32:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 -- start start 2023-12-19T13:32:44.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 0x7fc5900b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc590144e40 0x7fc590147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc59014ee10 0x7fc5901e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900b5b70 con 0x7fc590144e40 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5901e00f0 con 0x7fc59014ee10 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59879f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc590148400 con 0x7fc5900b0a40 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59653b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 0x7fc5900b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59653b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 0x7fc5900b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40822/0 (socket says 172.21.15.89:40822) 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc59653b640 1 -- 172.21.15.89:0/2113093397 learned_addr learned my addr 172.21.15.89:0/2113093397 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.724+0000 7fc596d3c640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc59014ee10 0x7fc5901e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc595d3a640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc590144e40 0x7fc590147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59653b640 1 -- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc59014ee10 msgr2=0x7fc5901e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59653b640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc59014ee10 0x7fc5901e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59653b640 1 -- 172.21.15.89:0/2113093397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc590144e40 msgr2=0x7fc590147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59653b640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc590144e40 0x7fc590147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59653b640 1 -- 172.21.15.89:0/2113093397 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009a70 con 0x7fc5900b0a40 2023-12-19T13:32:44.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc595d3a640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc590144e40 0x7fc590147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59653b640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 0x7fc5900b5630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc58c000c00 tx=0x7fc58c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c039c90 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c039e10 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0094d0 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c043640 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5901e0930 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc58c043aa0 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.725+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc58c03e070 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.726+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc590073a40 con 0x7fc5900b0a40 2023-12-19T13:32:44.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.728+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc58c034070 con 0x7fc5900b0a40 2023-12-19T13:32:44.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.798+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3c314916-8775-4069-b8a8-b98969fb7138", "id": 1} v 0) v1 -- 0x7fc5900b9090 con 0x7fc5900b0a40 2023-12-19T13:32:44.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.802+0000 7fc586ffd640 1 -- 172.21.15.89:0/2113093397 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c314916-8775-4069-b8a8-b98969fb7138", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc58c04d460 con 0x7fc5900b0a40 2023-12-19T13:32:44.804 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 msgr2=0x7fc5900b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 0x7fc5900b5630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc58c000c00 tx=0x7fc58c004730 comp rx=0 tx=0).stop 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 shutdown_connections 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc59014ee10 0x7fc5901e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc590144e40 0x7fc590147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 --2- 172.21.15.89:0/2113093397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b0a40 0x7fc5900b5630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 >> 172.21.15.89:0/2113093397 conn(0x7fc59006ae10 msgr2=0x7fc59006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 shutdown_connections 2023-12-19T13:32:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.803+0000 7fc59879f640 1 -- 172.21.15.89:0/2113093397 wait complete. 2023-12-19T13:32:44.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new e9a9a409-78c2-45d9-8ca2-934f18d032ee 2 2023-12-19T13:32:44.895 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:44.892+0000 7f2d3aa17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T13:32:44.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 Processor -- start 2023-12-19T13:32:44.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 -- start start 2023-12-19T13:32:44.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2e40b7410 0x7fc2e406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2e4152aa0 0x7fc2e4154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40ba5d0 con 0x7fc2e4065c10 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40bbf00 con 0x7fc2e40b7410 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.913+0000 7fc2e948b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e4072130 con 0x7fc2e4152aa0 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2e4152aa0 0x7fc2e4154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2e40b7410 0x7fc2e406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc2e4065c10 0x7fc2e40ba800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.89:41256/0 (socket says 172.21.15.89:41256) 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2e4152aa0 0x7fc2e4154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39864/0 (socket says 172.21.15.89:39864) 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e2ffd640 1 -- 172.21.15.89:0/2486476812 learned_addr learned my addr 172.21.15.89:0/2486476812 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2486476812 >> v2:172.21.15.6:3300/0 conn(0x7fc2e40b7410 msgr2=0x7fc2e406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e37fe640 1 --2- 172.21.15.89:0/2486476812 >> v2:172.21.15.6:3300/0 conn(0x7fc2e40b7410 0x7fc2e406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2486476812 >> v1:172.21.15.6:6789/0 conn(0x7fc2e4065c10 legacy=0x7fc2e40ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2486476812 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e406a3b0 con 0x7fc2e4152aa0 2023-12-19T13:32:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.914+0000 7fc2e27fc640 1 --2- 172.21.15.89:0/2486476812 >> v2:172.21.15.6:3300/0 conn(0x7fc2e40b7410 0x7fc2e406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.915+0000 7fc2e37fe640 1 --2- 172.21.15.89:0/2486476812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e4154e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2e406ae10 tx=0x7fc2dc02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd822989a2e596f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.915+0000 7fc2e1ffb640 1 -- 172.21.15.89:0/2486476812 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc02cbf0 con 0x7fc2e4152aa0 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.915+0000 7fc2e1ffb640 1 -- 172.21.15.89:0/2486476812 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc02cd50 con 0x7fc2e4152aa0 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.915+0000 7fc2e1ffb640 1 -- 172.21.15.89:0/2486476812 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc034660 con 0x7fc2e4152aa0 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 -- 172.21.15.89:0/2486476812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 msgr2=0x7fc2e4154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2486476812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e4154e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2e406ae10 tx=0x7fc2dc02be40 comp rx=0 tx=0).stop 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 -- 172.21.15.89:0/2486476812 shutdown_connections 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2486476812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e4154e90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2486476812 >> v2:172.21.15.6:3300/0 conn(0x7fc2e40b7410 0x7fc2e406a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 -- 172.21.15.89:0/2486476812 >> 172.21.15.89:0/2486476812 conn(0x7fc2e40b9250 msgr2=0x7fc2e40b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 -- 172.21.15.89:0/2486476812 shutdown_connections 2023-12-19T13:32:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.916+0000 7fc2e948b640 1 -- 172.21.15.89:0/2486476812 wait complete. 2023-12-19T13:32:44.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.918+0000 7fc2e948b640 1 Processor -- start 2023-12-19T13:32:44.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.918+0000 7fc2e948b640 1 -- start start 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4065c10 0x7fc2e41e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 0x7fc2e41e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e414a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4070ab0 con 0x7fc2e4065c10 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e406fe90 con 0x7fc2e4152aa0 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e406fb80 con 0x7fc2e40b7410 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e27fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 0x7fc2e41e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e414a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e414a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39876/0 (socket says 172.21.15.89:39876) 2023-12-19T13:32:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e27fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 0x7fc2e41e3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40824/0 (socket says 172.21.15.89:40824) 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2995574541 learned_addr learned my addr 172.21.15.89:0/2995574541 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e2ffd640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4065c10 0x7fc2e41e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 msgr2=0x7fc2e41e3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 0x7fc2e41e3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2995574541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4065c10 msgr2=0x7fc2e41e4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4065c10 0x7fc2e41e4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 -- 172.21.15.89:0/2995574541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8009400 con 0x7fc2e4152aa0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e27fc640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 0x7fc2e41e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e2ffd640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4065c10 0x7fc2e41e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e37fe640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e414a040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009e80 tx=0x7fc2dc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc040650 con 0x7fc2e4152aa0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0407b0 con 0x7fc2e4152aa0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.919+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2dc009a70 con 0x7fc2e4152aa0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.920+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc040b60 con 0x7fc2e4152aa0 2023-12-19T13:32:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.920+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40706f0 con 0x7fc2e4152aa0 2023-12-19T13:32:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.920+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc2dc049400 con 0x7fc2e4152aa0 2023-12-19T13:32:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.920+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc2dc03e820 con 0x7fc2e4152aa0 2023-12-19T13:32:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.920+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e4070880 con 0x7fc2e4152aa0 2023-12-19T13:32:44.925 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:44.921+0000 7fd220a2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T13:32:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.924+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc2dc067b10 con 0x7fc2e4152aa0 2023-12-19T13:32:44.952 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:44.950+0000 7f2d3aa17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T13:32:44.978 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:44.976+0000 7fd220a2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T13:32:44.997 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:44.995+0000 7f2d3aa17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T13:32:44.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:44.995+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e9a9a409-78c2-45d9-8ca2-934f18d032ee", "id": 2} v 0) v1 -- 0x7fc2e40701a0 con 0x7fc2e4152aa0 2023-12-19T13:32:45.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.002+0000 7fc2cb7fe640 1 -- 172.21.15.89:0/2995574541 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9a9a409-78c2-45d9-8ca2-934f18d032ee", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc2e40701a0 con 0x7fc2e4152aa0 2023-12-19T13:32:45.005 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 msgr2=0x7fc2e414a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e414a040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009e80 tx=0x7fc2dc004a40 comp rx=0 tx=0).stop 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 shutdown_connections 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2e4152aa0 0x7fc2e414a040 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2e40b7410 0x7fc2e41e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 --2- 172.21.15.89:0/2995574541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4065c10 0x7fc2e41e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 >> 172.21.15.89:0/2995574541 conn(0x7fc2e40b9250 msgr2=0x7fc2e409d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.003+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 shutdown_connections 2023-12-19T13:32:45.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.004+0000 7fc2e948b640 1 -- 172.21.15.89:0/2995574541 wait complete. 2023-12-19T13:32:45.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 9052f48d-ab33-4b57-b85e-1f7992dc7900 3 2023-12-19T13:32:45.024 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.022+0000 7fd220a2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T13:32:45.054 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.052+0000 7f2d3aa17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T13:32:45.080 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.078+0000 7fd220a2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T13:32:45.098 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.096+0000 7f2d3aa17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T13:32:45.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 Processor -- start 2023-12-19T13:32:45.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 -- start start 2023-12-19T13:32:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c1c0b6770 0x7f3c1c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1c1486a0 con 0x7f3c1c06b930 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1c071b90 con 0x7f3c1c0b6770 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c230db640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0b6ff0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c21678640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c21678640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40838/0 (socket says 172.21.15.89:40838) 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.113+0000 7f3c21678640 1 -- 172.21.15.89:0/695518102 learned_addr learned my addr 172.21.15.89:0/695518102 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.114+0000 7f3c20e77640 1 --2- 172.21.15.89:0/695518102 >> v2:172.21.15.6:3300/0 conn(0x7f3c1c0b6770 0x7f3c1c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.114+0000 7f3c21678640 1 -- 172.21.15.89:0/695518102 >> v2:172.21.15.6:3300/0 conn(0x7f3c1c0b6770 msgr2=0x7f3c1c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.114+0000 7f3c21678640 1 --2- 172.21.15.89:0/695518102 >> v2:172.21.15.6:3300/0 conn(0x7f3c1c0b6770 0x7f3c1c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.114+0000 7f3c21678640 1 -- 172.21.15.89:0/695518102 >> v1:172.21.15.6:6789/0 conn(0x7f3c1c06b930 legacy=0x7f3c1c0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.114+0000 7f3c21678640 1 -- 172.21.15.89:0/695518102 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c147d70 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.115+0000 7f3c21678640 1 --2- 172.21.15.89:0/695518102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c152250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400d150 tx=0x7f3c1402e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d35b172aba21e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.115+0000 7f3c1b7fe640 1 -- 172.21.15.89:0/695518102 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400b0d0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.115+0000 7f3c1b7fe640 1 -- 172.21.15.89:0/695518102 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1400b230 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.115+0000 7f3c1b7fe640 1 -- 172.21.15.89:0/695518102 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14009600 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 -- 172.21.15.89:0/695518102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 msgr2=0x7f3c1c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 --2- 172.21.15.89:0/695518102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c152250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400d150 tx=0x7f3c1402e160 comp rx=0 tx=0).stop 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 -- 172.21.15.89:0/695518102 shutdown_connections 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 --2- 172.21.15.89:0/695518102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c152250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 --2- 172.21.15.89:0/695518102 >> v2:172.21.15.6:3300/0 conn(0x7f3c1c0b6770 0x7f3c1c06d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 -- 172.21.15.89:0/695518102 >> 172.21.15.89:0/695518102 conn(0x7f3c1c06ae10 msgr2=0x7f3c1c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 -- 172.21.15.89:0/695518102 shutdown_connections 2023-12-19T13:32:45.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.116+0000 7f3c230db640 1 -- 172.21.15.89:0/695518102 wait complete. 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.117+0000 7f3c230db640 1 Processor -- start 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.117+0000 7f3c230db640 1 -- start start 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c1c0b6770 0x7f3c1c0a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c1c0a2180 0x7f3c1c1dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0b3bc0 con 0x7f3c1c0b6770 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0b2b50 con 0x7f3c1c0a2180 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c1d35c0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c0b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40852/0 (socket says 172.21.15.89:40852) 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 -- 172.21.15.89:0/3862426869 learned_addr learned my addr 172.21.15.89:0/3862426869 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c21678640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c1c0a2180 0x7f3c1c1dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c1bfff640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c1c0b6770 0x7f3c1c0a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 -- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c1c0a2180 msgr2=0x7f3c1c1dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c1c0a2180 0x7f3c1c1dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 -- 172.21.15.89:0/3862426869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c1c0b6770 msgr2=0x7f3c1c0a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c1c0b6770 0x7f3c1c0a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 -- 172.21.15.89:0/3862426869 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1400bd40 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c21678640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c1c0a2180 0x7f3c1c1dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c1bfff640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c1c0b6770 0x7f3c1c0a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c20e77640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c0b2610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000e870 tx=0x7f3c1000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100094f0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1000c940 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c0b38e0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000ccf0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.118+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c099000 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.119+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c10005c90 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.119+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3c100067f0 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.119+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c098b80 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.124 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.122+0000 7fd220a2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T13:32:45.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.121+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3c1c098b80 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.193+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9052f48d-ab33-4b57-b85e-1f7992dc7900", "id": 3} v 0) v1 -- 0x7f3c1c073a40 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.201+0000 7f3c197fa640 1 -- 172.21.15.89:0/3862426869 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9052f48d-ab33-4b57-b85e-1f7992dc7900", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c10021060 con 0x7f3c1c06dbc0 2023-12-19T13:32:45.203 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-12-19T13:32:45.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 msgr2=0x7f3c1c0b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c0b2610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000e870 tx=0x7f3c1000ed30 comp rx=0 tx=0).stop 2023-12-19T13:32:45.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 shutdown_connections 2023-12-19T13:32:45.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c1c0a2180 0x7f3c1c1dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c1c0b6770 0x7f3c1c0a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 --2- 172.21.15.89:0/3862426869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c1c06dbc0 0x7f3c1c0b2610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 >> 172.21.15.89:0/3862426869 conn(0x7f3c1c06ae10 msgr2=0x7f3c1c06cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 shutdown_connections 2023-12-19T13:32:45.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.202+0000 7f3c230db640 1 -- 172.21.15.89:0/3862426869 wait complete. 2023-12-19T13:32:45.205 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.203+0000 7f2d3aa17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T13:32:45.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new a20c9448-a2c0-4f0d-a4b3-beac6638b7db 4 2023-12-19T13:32:45.229 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.227+0000 7fd220a2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T13:32:45.277 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.275+0000 7f2d3aa17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T13:32:45.302 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.300+0000 7fd220a2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T13:32:45.326 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.323+0000 7f2d3aa17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T13:32:45.349 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.347+0000 7fd220a2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T13:32:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.351+0000 7f7d78963640 1 Processor -- start 2023-12-19T13:32:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.351+0000 7f7d78963640 1 -- start start 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d78963640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d740b75b0 0x7f7d740b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d78963640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d740b5a10 0x7f7d74153330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d78963640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d740bb210 con 0x7f7d74142d30 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d78963640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740ba530 con 0x7f7d740b75b0 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d78963640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740b55c0 con 0x7f7d740b5a10 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d740b5a10 0x7f7d74153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d740b5a10 0x7f7d74153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39894/0 (socket says 172.21.15.89:39894) 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d7259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7d74142d30 0x7f7d740bab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47058/0 (socket says 172.21.15.89:47058) 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 -- 172.21.15.89:0/2148850839 learned_addr learned my addr 172.21.15.89:0/2148850839 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d6bfff640 1 --2- 172.21.15.89:0/2148850839 >> v2:172.21.15.6:3300/0 conn(0x7f7d740b75b0 0x7f7d740b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 -- 172.21.15.89:0/2148850839 >> v2:172.21.15.6:3300/0 conn(0x7f7d740b75b0 msgr2=0x7f7d740b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 --2- 172.21.15.89:0/2148850839 >> v2:172.21.15.6:3300/0 conn(0x7f7d740b75b0 0x7f7d740b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 -- 172.21.15.89:0/2148850839 >> v1:172.21.15.89:6789/0 conn(0x7f7d74142d30 legacy=0x7f7d740bab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.352+0000 7f7d72d9d640 1 -- 172.21.15.89:0/2148850839 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740b9850 con 0x7f7d740b5a10 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.353+0000 7f7d72d9d640 1 --2- 172.21.15.89:0/2148850839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d740b5a10 0x7f7d74153330 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7d740b8cf0 tx=0x7f7d6c02c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe21739e93ecdb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.353+0000 7f7d71d9b640 1 -- 172.21.15.89:0/2148850839 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c02cbb0 con 0x7f7d740b5a10 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.353+0000 7f7d71d9b640 1 -- 172.21.15.89:0/2148850839 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c02cd10 con 0x7f7d740b5a10 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.353+0000 7f7d71d9b640 1 -- 172.21.15.89:0/2148850839 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c034610 con 0x7f7d740b5a10 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 -- 172.21.15.89:0/2148850839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d740b5a10 msgr2=0x7f7d74153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 --2- 172.21.15.89:0/2148850839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d740b5a10 0x7f7d74153330 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7d740b8cf0 tx=0x7f7d6c02c010 comp rx=0 tx=0).stop 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 -- 172.21.15.89:0/2148850839 shutdown_connections 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 --2- 172.21.15.89:0/2148850839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d740b5a10 0x7f7d74153330 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 --2- 172.21.15.89:0/2148850839 >> v2:172.21.15.6:3300/0 conn(0x7f7d740b75b0 0x7f7d740b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 -- 172.21.15.89:0/2148850839 >> 172.21.15.89:0/2148850839 conn(0x7f7d74069d00 msgr2=0x7f7d7406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 -- 172.21.15.89:0/2148850839 shutdown_connections 2023-12-19T13:32:45.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.354+0000 7f7d78963640 1 -- 172.21.15.89:0/2148850839 wait complete. 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.355+0000 7f7d78963640 1 Processor -- start 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.355+0000 7f7d78963640 1 -- start start 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d78963640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 0x7f7d741e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d78963640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d740b75b0 0x7f7d7414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d78963640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d74142d30 0x7f7d74141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d78963640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7414c7f0 con 0x7f7d740b75b0 2023-12-19T13:32:45.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d78963640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d741e1ff0 con 0x7f7d74142d30 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d78963640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74142270 con 0x7f7d740b5a10 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d7259c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 0x7f7d741e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d74142d30 0x7f7d74141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d7259c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 0x7f7d741e1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40866/0 (socket says 172.21.15.89:40866) 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d7259c640 1 -- 172.21.15.89:0/38720292 learned_addr learned my addr 172.21.15.89:0/38720292 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d6bfff640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d740b75b0 0x7f7d7414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 -- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 msgr2=0x7f7d741e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 0x7f7d741e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 -- 172.21.15.89:0/38720292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d740b75b0 msgr2=0x7f7d7414b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d740b75b0 0x7f7d7414b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 -- 172.21.15.89:0/38720292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009b30 con 0x7f7d74142d30 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d7259c640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 0x7f7d741e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:45.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d72d9d640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d74142d30 0x7f7d74141190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d74071fa0 tx=0x7f7d6c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.356+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c009510 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.357+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c03e450 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.357+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d741e1a70 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.357+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c03e800 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.357+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d74149b50 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.357+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7d6c03ec60 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.357+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7d6c03f400 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.358+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d74073a40 con 0x7f7d74142d30 2023-12-19T13:32:45.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.360+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f7d6c043020 con 0x7f7d74142d30 2023-12-19T13:32:45.389 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.387+0000 7f2d3aa17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T13:32:45.403 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.402+0000 7fd220a2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T13:32:45.437 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.434+0000 7f2d3aa17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T13:32:45.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.441+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a20c9448-a2c0-4f0d-a4b3-beac6638b7db", "id": 4} v 0) v1 -- 0x7f7d740b9250 con 0x7f7d74142d30 2023-12-19T13:32:45.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.448+0000 7f7d6affd640 1 -- 172.21.15.89:0/38720292 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a20c9448-a2c0-4f0d-a4b3-beac6638b7db", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7d6c048400 con 0x7f7d74142d30 2023-12-19T13:32:45.451 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d74142d30 msgr2=0x7f7d74141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d74142d30 0x7f7d74141190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d74071fa0 tx=0x7f7d6c004a40 comp rx=0 tx=0).stop 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 shutdown_connections 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d74142d30 0x7f7d74141190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d740b75b0 0x7f7d7414b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 --2- 172.21.15.89:0/38720292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d740b5a10 0x7f7d741e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 >> 172.21.15.89:0/38720292 conn(0x7f7d74069d00 msgr2=0x7f7d7406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 shutdown_connections 2023-12-19T13:32:45.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.449+0000 7f7d78963640 1 -- 172.21.15.89:0/38720292 wait complete. 2023-12-19T13:32:45.453 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.451+0000 7fd220a2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T13:32:45.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 038a605f-2df7-47b5-8ca6-d6410ca02cda 5 2023-12-19T13:32:45.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.599+0000 7f7ca5441640 1 Processor -- start 2023-12-19T13:32:45.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.599+0000 7f7ca5441640 1 -- start start 2023-12-19T13:32:45.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7ca5441640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ca0144e40 0x7f7ca006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7ca5441640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 0x7f7ca014e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7ca5441640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca014f0d0 con 0x7f7ca014ec40 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7ca5441640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0070630 con 0x7f7ca0144e40 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7ca5441640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0070070 con 0x7f7ca00b0a40 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 0x7f7ca014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 0x7f7ca014e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40880/0 (socket says 172.21.15.89:40880) 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/2671332222 learned_addr learned my addr 172.21.15.89:0/2671332222 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9effd640 1 --2- 172.21.15.89:0/2671332222 >> v2:172.21.15.6:3300/0 conn(0x7f7ca0144e40 0x7f7ca006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/2671332222 >> v2:172.21.15.6:3300/0 conn(0x7f7ca0144e40 msgr2=0x7f7ca006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 --2- 172.21.15.89:0/2671332222 >> v2:172.21.15.6:3300/0 conn(0x7f7ca0144e40 0x7f7ca006d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/2671332222 >> v1:172.21.15.6:6789/0 conn(0x7f7ca014ec40 legacy=0x7f7ca0069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.600+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/2671332222 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca0070350 con 0x7f7ca00b0a40 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.601+0000 7f7c9e7fc640 1 --2- 172.21.15.89:0/2671332222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 0x7f7ca014e700 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2cf62f0af965f36 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.601+0000 7f7c9dffb640 1 -- 172.21.15.89:0/2671332222 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90030840 con 0x7f7ca00b0a40 2023-12-19T13:32:45.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.601+0000 7f7c9dffb640 1 -- 172.21.15.89:0/2671332222 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900309a0 con 0x7f7ca00b0a40 2023-12-19T13:32:45.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.601+0000 7f7c9dffb640 1 -- 172.21.15.89:0/2671332222 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90030d30 con 0x7f7ca00b0a40 2023-12-19T13:32:45.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 -- 172.21.15.89:0/2671332222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 msgr2=0x7f7ca014e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.607 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 --2- 172.21.15.89:0/2671332222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 0x7f7ca014e700 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9002b980 comp rx=0 tx=0).stop 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 -- 172.21.15.89:0/2671332222 shutdown_connections 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 --2- 172.21.15.89:0/2671332222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca00b0a40 0x7f7ca014e700 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 --2- 172.21.15.89:0/2671332222 >> v2:172.21.15.6:3300/0 conn(0x7f7ca0144e40 0x7f7ca006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 -- 172.21.15.89:0/2671332222 >> 172.21.15.89:0/2671332222 conn(0x7f7ca006ae10 msgr2=0x7f7ca006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 -- 172.21.15.89:0/2671332222 shutdown_connections 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.602+0000 7f7ca5441640 1 -- 172.21.15.89:0/2671332222 wait complete. 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.603+0000 7f7ca5441640 1 Processor -- start 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.603+0000 7f7ca5441640 1 -- start start 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca00b0a40 0x7f7ca014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 0x7f7ca01e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca014ec40 0x7f7ca01e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014a6d0 con 0x7f7ca00b0a40 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014af90 con 0x7f7ca014ec40 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00b2b20 con 0x7f7ca0144e40 2023-12-19T13:32:45.608 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 0x7f7ca01e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca014ec40 0x7f7ca01e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 0x7f7ca01e33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40882/0 (socket says 172.21.15.89:40882) 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/1681637296 learned_addr learned my addr 172.21.15.89:0/1681637296 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9effd640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca00b0a40 0x7f7ca014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca014ec40 msgr2=0x7f7ca01e38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca014ec40 0x7f7ca01e38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/1681637296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca00b0a40 msgr2=0x7f7ca014a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca00b0a40 0x7f7ca014a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 -- 172.21.15.89:0/1681637296 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900094d0 con 0x7f7ca0144e40 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c9e7fc640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 0x7f7ca01e33b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7c9002b9c0 tx=0x7f7c90004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90039a90 con 0x7f7ca0144e40 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90039bf0 con 0x7f7ca0144e40 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00b11e0 con 0x7f7ca0144e40 2023-12-19T13:32:45.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90043410 con 0x7f7ca0144e40 2023-12-19T13:32:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.604+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00b17a0 con 0x7f7ca0144e40 2023-12-19T13:32:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.605+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7c90043870 con 0x7f7ca0144e40 2023-12-19T13:32:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.605+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7c9002f910 con 0x7f7ca0144e40 2023-12-19T13:32:45.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.605+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0073a40 con 0x7f7ca0144e40 2023-12-19T13:32:45.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.609+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f7c90048070 con 0x7f7ca0144e40 2023-12-19T13:32:45.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.680+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "038a605f-2df7-47b5-8ca6-d6410ca02cda", "id": 5} v 0) v1 -- 0x7f7ca00b8e90 con 0x7f7ca0144e40 2023-12-19T13:32:45.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.688+0000 7f7c877fe640 1 -- 172.21.15.89:0/1681637296 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "038a605f-2df7-47b5-8ca6-d6410ca02cda", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c90034070 con 0x7f7ca0144e40 2023-12-19T13:32:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 msgr2=0x7f7ca01e33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 0x7f7ca01e33b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7c9002b9c0 tx=0x7f7c90004730 comp rx=0 tx=0).stop 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 shutdown_connections 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca014ec40 0x7f7ca01e38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca0144e40 0x7f7ca01e33b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 --2- 172.21.15.89:0/1681637296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca00b0a40 0x7f7ca014a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 >> 172.21.15.89:0/1681637296 conn(0x7f7ca006ae10 msgr2=0x7f7ca006d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 shutdown_connections 2023-12-19T13:32:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.689+0000 7f7ca5441640 1 -- 172.21.15.89:0/1681637296 wait complete. 2023-12-19T13:32:45.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247 6 2023-12-19T13:32:45.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.798+0000 7fd7682b2640 1 Processor -- start 2023-12-19T13:32:45.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.798+0000 7fd7682b2640 1 -- start start 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd7682b2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7600b0a40 0x7fd76014e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd7682b2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd76014ec40 0x7fd7601554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd7682b2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76006dd90 con 0x7fd760144e40 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd7682b2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76014f0b0 con 0x7fd76014ec40 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd7682b2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd760070630 con 0x7fd7600b0a40 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76604e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd760144e40 0x7fd76006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47074/0 (socket says 172.21.15.89:47074) 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76584d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7600b0a40 0x7fd76014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76604e640 1 -- 172.21.15.89:0/830619135 learned_addr learned my addr 172.21.15.89:0/830619135 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-19T13:32:45.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76684f640 1 --2- 172.21.15.89:0/830619135 >> v2:172.21.15.6:3300/0 conn(0x7fd76014ec40 0x7fd7601554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76584d640 1 -- 172.21.15.89:0/830619135 >> v2:172.21.15.6:3300/0 conn(0x7fd76014ec40 msgr2=0x7fd7601554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:45.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76584d640 1 --2- 172.21.15.89:0/830619135 >> v2:172.21.15.6:3300/0 conn(0x7fd76014ec40 0x7fd7601554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76584d640 1 -- 172.21.15.89:0/830619135 >> v1:172.21.15.89:6789/0 conn(0x7fd760144e40 legacy=0x7fd76006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76504c640 1 -- 172.21.15.89:0/830619135 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284496415 0 0) 0x7fd76006dd90 con 0x7fd760144e40 2023-12-19T13:32:45.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.799+0000 7fd76584d640 1 -- 172.21.15.89:0/830619135 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760070070 con 0x7fd7600b0a40 2023-12-19T13:32:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.800+0000 7fd76584d640 1 --2- 172.21.15.89:0/830619135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd76014e700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7600b9aa0 tx=0x7fd75c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29c80dadf2d4ac74 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.800+0000 7fd76504c640 1 -- 172.21.15.89:0/830619135 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c031830 con 0x7fd7600b0a40 2023-12-19T13:32:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.800+0000 7fd76504c640 1 -- 172.21.15.89:0/830619135 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c031990 con 0x7fd7600b0a40 2023-12-19T13:32:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.800+0000 7fd76504c640 1 -- 172.21.15.89:0/830619135 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c031d20 con 0x7fd7600b0a40 2023-12-19T13:32:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 -- 172.21.15.89:0/830619135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 msgr2=0x7fd76014e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 --2- 172.21.15.89:0/830619135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd76014e700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7600b9aa0 tx=0x7fd75c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 -- 172.21.15.89:0/830619135 shutdown_connections 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 --2- 172.21.15.89:0/830619135 >> v2:172.21.15.6:3300/0 conn(0x7fd76014ec40 0x7fd7601554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 --2- 172.21.15.89:0/830619135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd76014e700 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 -- 172.21.15.89:0/830619135 >> 172.21.15.89:0/830619135 conn(0x7fd76006ae10 msgr2=0x7fd76006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 -- 172.21.15.89:0/830619135 shutdown_connections 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.801+0000 7fd7682b2640 1 -- 172.21.15.89:0/830619135 wait complete. 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.802+0000 7fd7682b2640 1 Processor -- start 2023-12-19T13:32:45.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.802+0000 7fd7682b2640 1 -- start start 2023-12-19T13:32:45.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd7601458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 0x7fd76014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76014ec40 0x7fd76014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76014daa0 con 0x7fd76014ec40 2023-12-19T13:32:45.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76014d140 con 0x7fd7600b0a40 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76014c290 con 0x7fd760144e40 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd7601458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76584d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 0x7fd76014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd7601458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39920/0 (socket says 172.21.15.89:39920) 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 -- 172.21.15.89:0/3930112320 learned_addr learned my addr 172.21.15.89:0/3930112320 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76584d640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 0x7fd76014cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40886/0 (socket says 172.21.15.89:40886) 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76684f640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76014ec40 0x7fd76014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 -- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 msgr2=0x7fd76014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 0x7fd76014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 -- 172.21.15.89:0/3930112320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76014ec40 msgr2=0x7fd76014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76014ec40 0x7fd76014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 -- 172.21.15.89:0/3930112320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009400 con 0x7fd7600b0a40 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76584d640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 0x7fd76014cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd76604e640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd7601458f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c4d0 tx=0x7fd75000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:45.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7500074e0 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750007660 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd760145f90 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750004a20 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.803+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76014d730 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.804+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd75001d440 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.804+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd7500129f0 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.805+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd760073a40 con 0x7fd7600b0a40 2023-12-19T13:32:45.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.807+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd750018070 con 0x7fd7600b0a40 2023-12-19T13:32:45.835 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.833+0000 7f2d3aa17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T13:32:45.850 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.848+0000 7fd220a2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T13:32:45.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.878+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247", "id": 6} v 0) v1 -- 0x7fd76006ceb0 con 0x7fd7600b0a40 2023-12-19T13:32:45.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd756ffd640 1 -- 172.21.15.89:0/3930112320 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd750012530 con 0x7fd7600b0a40 2023-12-19T13:32:45.888 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-12-19T13:32:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 msgr2=0x7fd7601458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd7601458f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c4d0 tx=0x7fd75000c990 comp rx=0 tx=0).stop 2023-12-19T13:32:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 shutdown_connections 2023-12-19T13:32:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76014ec40 0x7fd76014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd760144e40 0x7fd76014cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 --2- 172.21.15.89:0/3930112320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7600b0a40 0x7fd7601458f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.886+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 >> 172.21.15.89:0/3930112320 conn(0x7fd76006ae10 msgr2=0x7fd76006c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.887+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 shutdown_connections 2023-12-19T13:32:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.887+0000 7fd7682b2640 1 -- 172.21.15.89:0/3930112320 wait complete. 2023-12-19T13:32:45.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 0b544aa1-fec3-4bff-9058-81675b9610fe 7 2023-12-19T13:32:45.976 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:45.974+0000 7f2d3aa17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T13:32:45.992 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:45.990+0000 7fd220a2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T13:32:45.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.995+0000 7fe790b73640 1 Processor -- start 2023-12-19T13:32:45.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.995+0000 7fe790b73640 1 -- start start 2023-12-19T13:32:45.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe790b73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe78c0b6770 0x7fe78c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe790b73640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe78c06dbc0 0x7fe78c152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:45.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe790b73640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c1486a0 con 0x7fe78c06b930 2023-12-19T13:32:45.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe790b73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c071b90 con 0x7fe78c0b6770 2023-12-19T13:32:45.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe790b73640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c0b6ff0 con 0x7fe78c06dbc0 2023-12-19T13:32:45.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe78ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe78c06dbc0 0x7fe78c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe783fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe78c06b930 0x7fe78c0b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47082/0 (socket says 172.21.15.89:47082) 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe783fff640 1 -- 172.21.15.89:0/3213324102 learned_addr learned my addr 172.21.15.89:0/3213324102 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe78a59c640 1 --2- 172.21.15.89:0/3213324102 >> v2:172.21.15.6:3300/0 conn(0x7fe78c0b6770 0x7fe78c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe78ad9d640 1 -- 172.21.15.89:0/3213324102 >> v2:172.21.15.6:3300/0 conn(0x7fe78c0b6770 msgr2=0x7fe78c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe78ad9d640 1 --2- 172.21.15.89:0/3213324102 >> v2:172.21.15.6:3300/0 conn(0x7fe78c0b6770 0x7fe78c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe78ad9d640 1 -- 172.21.15.89:0/3213324102 >> v1:172.21.15.89:6789/0 conn(0x7fe78c06b930 legacy=0x7fe78c0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe789d9b640 1 -- 172.21.15.89:0/3213324102 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174366931 0 0) 0x7fe78c1486a0 con 0x7fe78c06b930 2023-12-19T13:32:46.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.996+0000 7fe78ad9d640 1 -- 172.21.15.89:0/3213324102 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c147d70 con 0x7fe78c06dbc0 2023-12-19T13:32:46.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.997+0000 7fe78ad9d640 1 --2- 172.21.15.89:0/3213324102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c06dbc0 0x7fe78c152250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0a32b0 tx=0x7fe78402e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804cb963590d8ec3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:46.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe789d9b640 1 -- 172.21.15.89:0/3213324102 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78402ea60 con 0x7fe78c06dbc0 2023-12-19T13:32:46.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe789d9b640 1 -- 172.21.15.89:0/3213324102 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78402ebc0 con 0x7fe78c06dbc0 2023-12-19T13:32:46.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe789d9b640 1 -- 172.21.15.89:0/3213324102 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784009540 con 0x7fe78c06dbc0 2023-12-19T13:32:46.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 -- 172.21.15.89:0/3213324102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c06dbc0 msgr2=0x7fe78c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 --2- 172.21.15.89:0/3213324102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c06dbc0 0x7fe78c152250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0a32b0 tx=0x7fe78402e0c0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 -- 172.21.15.89:0/3213324102 shutdown_connections 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 --2- 172.21.15.89:0/3213324102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c06dbc0 0x7fe78c152250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 --2- 172.21.15.89:0/3213324102 >> v2:172.21.15.6:3300/0 conn(0x7fe78c0b6770 0x7fe78c06d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 -- 172.21.15.89:0/3213324102 >> 172.21.15.89:0/3213324102 conn(0x7fe78c06ae10 msgr2=0x7fe78c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 -- 172.21.15.89:0/3213324102 shutdown_connections 2023-12-19T13:32:46.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.998+0000 7fe790b73640 1 -- 172.21.15.89:0/3213324102 wait complete. 2023-12-19T13:32:46.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:45.999+0000 7fe790b73640 1 Processor -- start 2023-12-19T13:32:46.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 -- start start 2023-12-19T13:32:46.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 0x7fe78c0b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe78c0b6770 0x7fe78c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c0b2280 0x7fe78c1dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0b1680 con 0x7fe78c0b6770 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c070580 con 0x7fe78c0b2280 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe790b73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0b2bf0 con 0x7fe78c06dbc0 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe78a59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 0x7fe78c0b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe78ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c0b2280 0x7fe78c1dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe78a59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 0x7fe78c0b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:40888/0 (socket says 172.21.15.89:40888) 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe78a59c640 1 -- 172.21.15.89:0/1831207824 learned_addr learned my addr 172.21.15.89:0/1831207824 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.000+0000 7fe783fff640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe78c0b6770 0x7fe78c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78a59c640 1 -- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c0b2280 msgr2=0x7fe78c1dffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78a59c640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c0b2280 0x7fe78c1dffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78a59c640 1 -- 172.21.15.89:0/1831207824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe78c0b6770 msgr2=0x7fe78c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78a59c640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe78c0b6770 0x7fe78c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78a59c640 1 -- 172.21.15.89:0/1831207824 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78400bc80 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78ad9d640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c0b2280 0x7fe78c1dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe78a59c640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 0x7fe78c0b1140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e8a0 tx=0x7fe77c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c009510 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c00c940 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c1d1e10 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00ccf0 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c070b00 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe77c005c90 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.001+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe77c006840 con 0x7fe78c06dbc0 2023-12-19T13:32:46.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.002+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c073a40 con 0x7fe78c06dbc0 2023-12-19T13:32:46.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.004+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe77c021060 con 0x7fe78c06dbc0 2023-12-19T13:32:46.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.075+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b544aa1-fec3-4bff-9058-81675b9610fe", "id": 7} v 0) v1 -- 0x7fe78c0b8ec0 con 0x7fe78c06dbc0 2023-12-19T13:32:46.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.081+0000 7fe782ffd640 1 -- 172.21.15.89:0/1831207824 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b544aa1-fec3-4bff-9058-81675b9610fe", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe77c029020 con 0x7fe78c06dbc0 2023-12-19T13:32:46.083 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.081+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 msgr2=0x7fe78c0b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.081+0000 7fe790b73640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 0x7fe78c0b1140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e8a0 tx=0x7fe77c00eca0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 shutdown_connections 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe78c0b2280 0x7fe78c1dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe78c0b6770 0x7fe78c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 --2- 172.21.15.89:0/1831207824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe78c06dbc0 0x7fe78c0b1140 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 >> 172.21.15.89:0/1831207824 conn(0x7fe78c06ae10 msgr2=0x7fe78c144f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:46.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 shutdown_connections 2023-12-19T13:32:46.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-19T13:32:46.082+0000 7fe790b73640 1 -- 172.21.15.89:0/1831207824 wait complete. 2023-12-19T13:32:46.094 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T13:32:46.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T13:32:46.096 INFO:tasks.ceph.osd.0:Started 2023-12-19T13:32:46.096 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T13:32:46.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T13:32:46.099 INFO:tasks.ceph.osd.1:Started 2023-12-19T13:32:46.099 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T13:32:46.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T13:32:46.101 INFO:tasks.ceph.osd.2:Started 2023-12-19T13:32:46.101 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T13:32:46.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T13:32:46.103 INFO:tasks.ceph.osd.3:Started 2023-12-19T13:32:46.103 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T13:32:46.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T13:32:46.105 INFO:tasks.ceph.osd.4:Started 2023-12-19T13:32:46.105 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T13:32:46.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T13:32:46.107 INFO:tasks.ceph.osd.5:Started 2023-12-19T13:32:46.108 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T13:32:46.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T13:32:46.108 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.105+0000 7f2d3aa17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T13:32:46.110 INFO:tasks.ceph.osd.6:Started 2023-12-19T13:32:46.110 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T13:32:46.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T13:32:46.112 INFO:tasks.ceph.osd.7:Started 2023-12-19T13:32:46.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:32:46.125 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.123+0000 7fd220a2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T13:32:46.161 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.158+0000 7f2d3aa17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T13:32:46.200 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.198+0000 7fd220a2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T13:32:46.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.240+0000 7fcbeed00640 1 Processor -- start 2023-12-19T13:32:46.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.240+0000 7fcbeed00640 1 -- start start 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeed00640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcbe80ba3a0 0x7fcbe806f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeed00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80ba780 con 0x7fcbe814ca90 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeed00640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe806f900 con 0x7fcbe806d7b0 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeed00640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe814c600 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeca9c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcbe80ba3a0 0x7fcbe806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbe7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcbe814ca90 0x7fcbe80b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58054/0 (socket says 172.21.15.6:58054) 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbe7fff640 1 -- 172.21.15.6:0/372505063 learned_addr learned my addr 172.21.15.6:0/372505063 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbed29d640 1 --1- 172.21.15.6:0/372505063 >> v1:172.21.15.89:6789/0 conn(0x7fcbe806d7b0 0x7fcbe8153210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59930/0 (socket says 172.21.15.6:59930) 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeca9c640 1 -- 172.21.15.6:0/372505063 >> v1:172.21.15.89:6789/0 conn(0x7fcbe806d7b0 legacy=0x7fcbe8153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbe77fe640 1 -- 172.21.15.6:0/372505063 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799675403 0 0) 0x7fcbe80ba780 con 0x7fcbe814ca90 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeca9c640 1 -- 172.21.15.6:0/372505063 >> v1:172.21.15.6:6789/0 conn(0x7fcbe814ca90 legacy=0x7fcbe80b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.241+0000 7fcbeca9c640 1 -- 172.21.15.6:0/372505063 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe806dbe0 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.242+0000 7fcbeca9c640 1 --2- 172.21.15.6:0/372505063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe80ba3a0 0x7fcbe806f230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009720 tx=0x7fcbdc02b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a45e849ee132271b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.242+0000 7fcbe77fe640 1 -- 172.21.15.6:0/372505063 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc030710 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.242+0000 7fcbe77fe640 1 -- 172.21.15.6:0/372505063 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc02e050 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.242+0000 7fcbe77fe640 1 -- 172.21.15.6:0/372505063 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc030a90 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 -- 172.21.15.6:0/372505063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe80ba3a0 msgr2=0x7fcbe806f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 --2- 172.21.15.6:0/372505063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe80ba3a0 0x7fcbe806f230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009720 tx=0x7fcbdc02b730 comp rx=0 tx=0).stop 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 -- 172.21.15.6:0/372505063 shutdown_connections 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 --2- 172.21.15.6:0/372505063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe80ba3a0 0x7fcbe806f230 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 -- 172.21.15.6:0/372505063 >> 172.21.15.6:0/372505063 conn(0x7fcbe80bac30 msgr2=0x7fcbe80bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 -- 172.21.15.6:0/372505063 shutdown_connections 2023-12-19T13:32:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.243+0000 7fcbeed00640 1 -- 172.21.15.6:0/372505063 wait complete. 2023-12-19T13:32:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.244+0000 7fcbeed00640 1 Processor -- start 2023-12-19T13:32:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.244+0000 7fcbeed00640 1 -- start start 2023-12-19T13:32:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeed00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d7b0 0x7fcbe80a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeed00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe80ba3a0 0x7fcbe81e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeed00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe814ca90 0x7fcbe813c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeed00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80b6970 con 0x7fcbe814ca90 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeed00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8147bc0 con 0x7fcbe806d7b0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeed00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8147ea0 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbed29d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe814ca90 0x7fcbe813c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbed29d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe814ca90 0x7fcbe813c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39324/0 (socket says 172.21.15.6:39324) 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe80ba3a0 0x7fcbe81e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbed29d640 1 -- 172.21.15.6:0/841364403 learned_addr learned my addr 172.21.15.6:0/841364403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbeca9c640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d7b0 0x7fcbe80a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbe7fff640 1 -- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d7b0 msgr2=0x7fcbe80a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbe7fff640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d7b0 0x7fcbe80a26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbe7fff640 1 -- 172.21.15.6:0/841364403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe814ca90 msgr2=0x7fcbe813c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbe7fff640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe814ca90 0x7fcbe813c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.245+0000 7fcbe7fff640 1 -- 172.21.15.6:0/841364403 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009400 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbe7fff640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe80ba3a0 0x7fcbe81e1390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c3e0 tx=0x7fcbd400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40074e0 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4007660 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe8148180 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4004a20 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe813c8e0 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcbd401d3f0 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.246+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcbd4013a90 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.247+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8066e10 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.249+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fcbd4013d70 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.274 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.272+0000 7f2d3aa17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:32:46.305 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.302+0000 7fd220a2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:32:46.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.310+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbe8073a40 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.310+0000 7fcbe57fa640 1 -- 172.21.15.6:0/841364403 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcbd40133c0 con 0x7fcbe80ba3a0 2023-12-19T13:32:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:32:46.313 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:32:46.077967+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe80ba3a0 msgr2=0x7fcbe81e1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe80ba3a0 0x7fcbe81e1390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c3e0 tx=0x7fcbd400c7e0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 shutdown_connections 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe814ca90 0x7fcbe813c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe80ba3a0 0x7fcbe81e1390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 --2- 172.21.15.6:0/841364403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d7b0 0x7fcbe80a26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 >> 172.21.15.6:0/841364403 conn(0x7fcbe80bac30 msgr2=0x7fcbe80bd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 shutdown_connections 2023-12-19T13:32:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:32:46.311+0000 7fcbeed00640 1 -- 172.21.15.6:0/841364403 wait complete. 2023-12-19T13:32:46.324 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T13:32:46.324 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T13:32:46.369 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.366+0000 7f2d3aa17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T13:32:46.404 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.402+0000 7fd220a2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T13:32:46.466 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T13:32:46.464+0000 7fdb59414500 -1 Falling back to public interface 2023-12-19T13:32:46.509 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.507+0000 7f2d3aa17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:32:46.549 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.547+0000 7fd220a2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T13:32:46.550 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.548+0000 7f2d3aa17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T13:32:46.593 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.591+0000 7fd220a2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T13:32:46.688 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:46.685+0000 7f2d3aa17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T13:32:46.709 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T13:32:46.706+0000 7f8effe0c500 -1 Falling back to public interface 2023-12-19T13:32:46.718 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T13:32:46.716+0000 7f972920f500 -1 Falling back to public interface 2023-12-19T13:32:46.723 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T13:32:46.721+0000 7effdf34a500 -1 Falling back to public interface 2023-12-19T13:32:46.729 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T13:32:46.727+0000 7f563ee1d500 -1 Falling back to public interface 2023-12-19T13:32:46.731 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T13:32:46.729+0000 7f27be816500 -1 Falling back to public interface 2023-12-19T13:32:46.733 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T13:32:46.731+0000 7f563d77a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6826/0: (98) Address already in use 2023-12-19T13:32:46.738 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T13:32:46.736+0000 7f95e7c1a500 -1 Falling back to public interface 2023-12-19T13:32:46.740 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:46.739+0000 7fd220a2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T13:32:46.746 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T13:32:46.744+0000 7fb971c9c500 -1 Falling back to public interface 2023-12-19T13:32:47.131 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T13:32:47.223 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 Processor -- start 2023-12-19T13:32:47.223 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 -- start start 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5aa8141ac0 0x7f5aa806ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5aa80b3e90 0x7f5aa8147780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa8070890 con 0x7f5aa8147cc0 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa8071d60 con 0x7f5aa8141ac0 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aadb3c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa806fe20 con 0x7f5aa80b3e90 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.221+0000 7f5aa77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5aa8141ac0 0x7f5aa806ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5aa8141ac0 0x7f5aa806ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40014/0 (socket says 172.21.15.6:40014) 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa77fe640 1 -- 172.21.15.6:0/3810265236 learned_addr learned my addr 172.21.15.6:0/3810265236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa6ffd640 1 --2- 172.21.15.6:0/3810265236 >> v2:172.21.15.89:3300/0 conn(0x7f5aa80b3e90 0x7f5aa8147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa77fe640 1 -- 172.21.15.6:0/3810265236 >> v2:172.21.15.89:3300/0 conn(0x7f5aa80b3e90 msgr2=0x7f5aa8147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/3810265236 >> v2:172.21.15.89:3300/0 conn(0x7f5aa80b3e90 0x7f5aa8147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.225 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa77fe640 1 -- 172.21.15.6:0/3810265236 >> v1:172.21.15.89:6789/0 conn(0x7f5aa8147cc0 legacy=0x7f5aa814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:47.226 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa77fe640 1 -- 172.21.15.6:0/3810265236 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8141ea0 con 0x7f5aa8141ac0 2023-12-19T13:32:47.226 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.222+0000 7f5aa6ffd640 1 --2- 172.21.15.6:0/3810265236 >> v2:172.21.15.89:3300/0 conn(0x7f5aa80b3e90 0x7f5aa8147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:32:47.226 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/3810265236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa8141ac0 0x7f5aa806ae10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80b4a30 tx=0x7f5a9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9557ce2999e3393a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:47.226 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aa67fc640 1 -- 172.21.15.6:0/3810265236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98031870 con 0x7f5aa8141ac0 2023-12-19T13:32:47.226 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aa67fc640 1 -- 172.21.15.6:0/3810265236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a980319d0 con 0x7f5aa8141ac0 2023-12-19T13:32:47.226 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aa67fc640 1 -- 172.21.15.6:0/3810265236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98031d60 con 0x7f5aa8141ac0 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 -- 172.21.15.6:0/3810265236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa8141ac0 msgr2=0x7f5aa806ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/3810265236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa8141ac0 0x7f5aa806ae10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80b4a30 tx=0x7f5a9802b910 comp rx=0 tx=0).stop 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 -- 172.21.15.6:0/3810265236 shutdown_connections 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/3810265236 >> v2:172.21.15.89:3300/0 conn(0x7f5aa80b3e90 0x7f5aa8147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/3810265236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa8141ac0 0x7f5aa806ae10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 -- 172.21.15.6:0/3810265236 >> 172.21.15.6:0/3810265236 conn(0x7f5aa80bd200 msgr2=0x7f5aa80bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 -- 172.21.15.6:0/3810265236 shutdown_connections 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.223+0000 7f5aadb3c640 1 -- 172.21.15.6:0/3810265236 wait complete. 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.224+0000 7f5aadb3c640 1 Processor -- start 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 -- start start 2023-12-19T13:32:47.229 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 0x7f5aa813d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5aa8141ac0 0x7f5aa813a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5aa8147cc0 0x7f5aa813ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa813dcd0 con 0x7f5aa80b3e90 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80b86e0 con 0x7f5aa8141ac0 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aadb3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa813d000 con 0x7f5aa8147cc0 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aa77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 0x7f5aa813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aa77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 0x7f5aa813d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40024/0 (socket says 172.21.15.6:40024) 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aa77fe640 1 -- 172.21.15.6:0/2114532185 learned_addr learned my addr 172.21.15.6:0/2114532185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aa6ffd640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5aa8141ac0 0x7f5aa813a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.225+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5aa8147cc0 0x7f5aa813ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aa77fe640 1 -- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5aa8147cc0 msgr2=0x7f5aa813ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5aa8147cc0 0x7f5aa813ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aa77fe640 1 -- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5aa8141ac0 msgr2=0x7f5aa813a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:47.230 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5aa8141ac0 0x7f5aa813a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aa77fe640 1 -- 172.21.15.6:0/2114532185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980094d0 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 0x7f5aa813d790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a98000c00 tx=0x7f5a980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98031840 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a980443f0 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa8139df0 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980447a0 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa813be60 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a98044c00 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.226+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5a9802d040 con 0x7f5aa80b3e90 2023-12-19T13:32:47.231 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.227+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa8070350 con 0x7f5aa80b3e90 2023-12-19T13:32:47.232 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.229+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f5aa8070350 con 0x7f5aa80b3e90 2023-12-19T13:32:47.292 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.290+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5aa813a310 con 0x7f5aa80b3e90 2023-12-19T13:32:47.293 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5a8ffff640 1 -- 172.21.15.6:0/2114532185 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5a98052060 con 0x7f5aa80b3e90 2023-12-19T13:32:47.293 INFO:teuthology.misc.health.smithi006.stdout: 2023-12-19T13:32:47.293 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:32:46.077967+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 msgr2=0x7f5aa813d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 0x7f5aa813d790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a98000c00 tx=0x7f5a980046c0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 shutdown_connections 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5aa8147cc0 0x7f5aa813ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5aa8141ac0 0x7f5aa813a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.291+0000 7f5aadb3c640 1 --2- 172.21.15.6:0/2114532185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa80b3e90 0x7f5aa813d790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.292+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 >> 172.21.15.6:0/2114532185 conn(0x7f5aa80bd200 msgr2=0x7f5aa806a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.292+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 shutdown_connections 2023-12-19T13:32:47.294 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:47.292+0000 7f5aadb3c640 1 -- 172.21.15.6:0/2114532185 wait complete. 2023-12-19T13:32:47.303 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T13:32:47.503 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:47.500+0000 7f2d3aa17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T13:32:47.553 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:47.550+0000 7fd220a2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T13:32:47.774 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:47.772+0000 7f2d3aa17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T13:32:47.826 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:47.824+0000 7f2d3aa17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T13:32:47.837 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:47.835+0000 7fd220a2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T13:32:47.891 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:47.889+0000 7fd220a2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T13:32:47.928 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:47.925+0000 7f2d3aa17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T13:32:47.997 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-12-19T13:32:47.995+0000 7fd220a2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T13:32:48.957 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:48.955+0000 7f2cdba91640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T13:32:48.957 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-19T13:32:48.955+0000 7f2cdba91640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T13:32:49.957 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T13:32:49.955+0000 7fdb59414500 -1 osd.2 0 log_to_monitors true 2023-12-19T13:32:50.182 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T13:32:50.180+0000 7f27be816500 -1 osd.3 0 log_to_monitors true 2023-12-19T13:32:50.225 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T13:32:50.222+0000 7effdf34a500 -1 osd.7 0 log_to_monitors true 2023-12-19T13:32:50.231 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T13:32:50.229+0000 7f8effe0c500 -1 osd.5 0 log_to_monitors true 2023-12-19T13:32:50.232 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T13:32:50.230+0000 7f972920f500 -1 osd.0 0 log_to_monitors true 2023-12-19T13:32:50.245 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T13:32:50.243+0000 7f563ee1d500 -1 osd.1 0 log_to_monitors true 2023-12-19T13:32:50.261 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T13:32:50.259+0000 7fb971c9c500 -1 osd.4 0 log_to_monitors true 2023-12-19T13:32:50.261 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T13:32:50.259+0000 7f95e7c1a500 -1 osd.6 0 log_to_monitors true 2023-12-19T13:32:54.035 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T13:32:54.032+0000 7f8efb574640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T13:32:54.045 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T13:32:54.043+0000 7f8ef3ba5640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.065 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T13:32:54.063+0000 7fb96d404640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T13:32:54.066 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T13:32:54.064+0000 7f972429a640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T13:32:54.074 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T13:32:54.072+0000 7f5639f3b640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T13:32:54.077 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T13:32:54.075+0000 7f971c8cb640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.077 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T13:32:54.075+0000 7fb965a35640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.079 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T13:32:54.077+0000 7effdaab4640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T13:32:54.086 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T13:32:54.084+0000 7f563256c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.090 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T13:32:54.088+0000 7f95e468b640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T13:32:54.096 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T13:32:54.094+0000 7effd30e5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.105 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T13:32:54.103+0000 7f95db481640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.108 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T13:32:54.106+0000 7fdb54583640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T13:32:54.110 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T13:32:54.116 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T13:32:54.114+0000 7f27b99df640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T13:32:54.122 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T13:32:54.120+0000 7fdb4cbb4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.131 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T13:32:54.129+0000 7f27b2010640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T13:32:54.202 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.199+0000 7f3ae6f73640 1 Processor -- start 2023-12-19T13:32:54.202 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.199+0000 7f3ae6f73640 1 -- start start 2023-12-19T13:32:54.203 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae6f73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ae0071170 0x7f3ae00b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae6f73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae0142970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae6f73640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ae00b9330 0x7f3ae0142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae6f73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae00ba1f0 con 0x7f3ae0071170 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae6f73640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae00b9850 con 0x7f3ae00b9330 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae6f73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00b9b30 con 0x7f3ae00b47d0 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae4d0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ae0071170 0x7f3ae00b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae4d0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ae0071170 0x7f3ae00b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40064/0 (socket says 172.21.15.6:40064) 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1966330246 learned_addr learned my addr 172.21.15.6:0/1966330246 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3adffff640 1 --2- 172.21.15.6:0/1966330246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae0142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.200+0000 7f3ae5510640 1 --2- 172.21.15.6:0/1966330246 >> v2:172.21.15.89:3300/0 conn(0x7f3ae00b9330 0x7f3ae0142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.201+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1966330246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 msgr2=0x7f3ae0142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.201+0000 7f3ae4d0f640 1 --2- 172.21.15.6:0/1966330246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae0142970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.201+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1966330246 >> v2:172.21.15.89:3300/0 conn(0x7f3ae00b9330 msgr2=0x7f3ae0142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:32:54.204 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.201+0000 7f3ae4d0f640 1 --2- 172.21.15.6:0/1966330246 >> v2:172.21.15.89:3300/0 conn(0x7f3ae00b9330 0x7f3ae0142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.205 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.201+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1966330246 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00b9e80 con 0x7f3ae0071170 2023-12-19T13:32:54.205 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.201+0000 7f3ae4d0f640 1 --2- 172.21.15.6:0/1966330246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae00b4290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ae006d620 tx=0x7f3ad402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a8329a02862080 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:54.205 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3adf7fe640 1 -- 172.21.15.6:0/1966330246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4030860 con 0x7f3ae0071170 2023-12-19T13:32:54.205 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3adf7fe640 1 -- 172.21.15.6:0/1966330246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad40309c0 con 0x7f3ae0071170 2023-12-19T13:32:54.205 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3adf7fe640 1 -- 172.21.15.6:0/1966330246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4030d50 con 0x7f3ae0071170 2023-12-19T13:32:54.207 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1966330246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 msgr2=0x7f3ae00b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:54.207 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1966330246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae00b4290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ae006d620 tx=0x7f3ad402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.207 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1966330246 shutdown_connections 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1966330246 >> v2:172.21.15.89:3300/0 conn(0x7f3ae00b9330 0x7f3ae0142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1966330246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae0142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1966330246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae00b4290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1966330246 >> 172.21.15.6:0/1966330246 conn(0x7f3ae00be140 msgr2=0x7f3ae00be550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1966330246 shutdown_connections 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.202+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1966330246 wait complete. 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.203+0000 7f3ae6f73640 1 Processor -- start 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.203+0000 7f3ae6f73640 1 -- start start 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae6f73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae0141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae6f73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae01de610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae6f73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ae00b9330 0x7f3ae01deb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae6f73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0141b50 con 0x7f3ae0071170 2023-12-19T13:32:54.208 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae6f73640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00bd2d0 con 0x7f3ae00b9330 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae6f73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00bd5b0 con 0x7f3ae00b47d0 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae0141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae0141610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40078/0 (socket says 172.21.15.6:40078) 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1629962436 learned_addr learned my addr 172.21.15.6:0/1629962436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae5510640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ae00b9330 0x7f3ae01deb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3adffff640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae01de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 msgr2=0x7f3ae01de610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae01de610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.209 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ae00b9330 msgr2=0x7f3ae01deb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ae00b9330 0x7f3ae01deb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.204+0000 7f3ae4d0f640 1 -- 172.21.15.6:0/1629962436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40094d0 con 0x7f3ae0071170 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.205+0000 7f3ae4d0f640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae0141610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4000c00 tx=0x7f3ad4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.205+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4039c90 con 0x7f3ae0071170 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.205+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad4039df0 con 0x7f3ae0071170 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.205+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae00bd890 con 0x7f3ae0071170 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.205+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4043640 con 0x7f3ae0071170 2023-12-19T13:32:54.210 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.205+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae00bde50 con 0x7f3ae0071170 2023-12-19T13:32:54.211 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.206+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae004e8d0 con 0x7f3ae0071170 2023-12-19T13:32:54.211 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.206+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7f3ad40437a0 con 0x7f3ae0071170 2023-12-19T13:32:54.211 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.206+0000 7f3add7fa640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ac406a3a0 0x7f3ac406c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:32:54.211 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.207+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f3ad403e070 con 0x7f3ae0071170 2023-12-19T13:32:54.211 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.207+0000 7f3adffff640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ac406a3a0 0x7f3ac406c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:32:54.211 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.207+0000 7f3adffff640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ac406a3a0 0x7f3ac406c860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ae01d5cb0 tx=0x7f3acc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:32:54.213 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.211+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ad4076f30 con 0x7f3ae0071170 2023-12-19T13:32:54.391 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.388+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ae01de370 con 0x7f3ae0071170 2023-12-19T13:32:54.391 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.389+0000 7f3add7fa640 1 -- 172.21.15.6:0/1629962436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3ad407a550 con 0x7f3ae0071170 2023-12-19T13:32:54.391 INFO:teuthology.misc.health.smithi006.stdout: 2023-12-19T13:32:54.391 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":12,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:32:51.957236+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.390+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ac406a3a0 msgr2=0x7f3ac406c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.390+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ac406a3a0 0x7f3ac406c860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ae01d5cb0 tx=0x7f3acc009190 comp rx=0 tx=0).stop 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.390+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 msgr2=0x7f3ae0141610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.390+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae0141610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4000c00 tx=0x7f3ad4004730 comp rx=0 tx=0).stop 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 shutdown_connections 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ac406a3a0 0x7f3ac406c860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ae00b9330 0x7f3ae01deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.393 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ae00b47d0 0x7f3ae01de610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.394 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 --2- 172.21.15.6:0/1629962436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae0071170 0x7f3ae0141610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:32:54.394 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 >> 172.21.15.6:0/1629962436 conn(0x7f3ae00be140 msgr2=0x7f3ae006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:32:54.394 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 shutdown_connections 2023-12-19T13:32:54.394 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:32:54.391+0000 7f3ae6f73640 1 -- 172.21.15.6:0/1629962436 wait complete. 2023-12-19T13:32:54.402 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T13:33:01.211 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:01.314 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.312+0000 7f8a02877640 1 Processor -- start 2023-12-19T13:33:01.314 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.312+0000 7f8a02877640 1 -- start start 2023-12-19T13:33:01.317 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.312+0000 7f8a02877640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89fc0b6280 0x7f89fc14e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f8a02877640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0baf30 con 0x7f89fc0b53f0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f8a02877640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0b6a00 con 0x7f89fc1482e0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f8a02877640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc14e5c0 con 0x7f89fc0b6280 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89fb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89fc0b53f0 0x7f89fc147bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59110/0 (socket says 172.21.15.6:59110) 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89fb7fe640 1 -- 172.21.15.6:0/2021660282 learned_addr learned my addr 172.21.15.6:0/2021660282 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89fbfff640 1 --2- 172.21.15.6:0/2021660282 >> v2:172.21.15.89:3300/0 conn(0x7f89fc0b6280 0x7f89fc14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674157810 0 0) 0x7f89fc0baf30 con 0x7f89fc0b53f0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e4003520 con 0x7f89fc0b53f0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160714770 0 0) 0x7f89e4003520 con 0x7f89fc0b53f0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 >> v2:172.21.15.89:3300/0 conn(0x7f89fc0b6280 msgr2=0x7f89fc14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 --2- 172.21.15.6:0/2021660282 >> v2:172.21.15.89:3300/0 conn(0x7f89fc0b6280 0x7f89fc14e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 >> v1:172.21.15.89:6789/0 conn(0x7f89fc1482e0 legacy=0x7f89fc0bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc14e880 con 0x7f89fc0b53f0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f89f0001670 con 0x7f89fc0b53f0 2023-12-19T13:33:01.318 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 >> v1:172.21.15.6:6789/0 conn(0x7f89fc0b53f0 legacy=0x7f89fc147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4003970 0x7f89e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40047c0 0x7f89e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e4005180 0x7f89e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc14e5c0 con 0x7f89e40047c0 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e400c020 con 0x7f89e4003970 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.313+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e400c1e0 con 0x7f89e4005180 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40047c0 0x7f89e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fbfff640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4003970 0x7f89e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f8a00e14640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e4005180 0x7f89e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fb7fe640 1 -- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e4005180 msgr2=0x7f89e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e4005180 0x7f89e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fb7fe640 1 -- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4003970 msgr2=0x7f89e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4003970 0x7f89e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f89fb7fe640 1 -- 172.21.15.6:0/2021660282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4003520 con 0x7f89e40047c0 2023-12-19T13:33:01.319 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f8a00e14640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e4005180 0x7f89e400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.314+0000 7f8a00e14640 1 -- 172.21.15.6:0/2021660282 reap_dead start 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40047c0 0x7f89e4004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c210 tx=0x7f89e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a31b63d62a27f93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0005ad0 con 0x7f89e40047c0 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0005c50 con 0x7f89e40047c0 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f89faffd640 1 -- 172.21.15.6:0/2021660282 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f002c890 con 0x7f89e40047c0 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 -- 172.21.15.6:0/2021660282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40047c0 msgr2=0x7f89e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40047c0 0x7f89e4004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c210 tx=0x7f89e40057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 -- 172.21.15.6:0/2021660282 shutdown_connections 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 --2- 172.21.15.6:0/2021660282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40047c0 0x7f89e4004c40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 -- 172.21.15.6:0/2021660282 >> 172.21.15.6:0/2021660282 conn(0x7f89fc0c05b0 msgr2=0x7f89fc0c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 -- 172.21.15.6:0/2021660282 shutdown_connections 2023-12-19T13:33:01.320 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.315+0000 7f8a02877640 1 -- 172.21.15.6:0/2021660282 wait complete. 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.316+0000 7f8a02877640 1 Processor -- start 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 -- start start 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e40047c0 0x7f89fc147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 0x7f89fc1e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89fc1e06e0 0x7f89fc13a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1475a0 con 0x7f89fc1e3560 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1dfd10 con 0x7f89e40047c0 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f8a02877640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1e3ac0 con 0x7f89fc1e06e0 2023-12-19T13:33:01.324 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 0x7f89fc1e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 0x7f89fc1e01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46142/0 (socket says 172.21.15.6:46142) 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.317+0000 7f89fb7fe640 1 -- 172.21.15.6:0/3039616869 learned_addr learned my addr 172.21.15.6:0/3039616869 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fbfff640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e40047c0 0x7f89fc147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f8a00e14640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89fc1e06e0 0x7f89fc13a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fb7fe640 1 -- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89fc1e06e0 msgr2=0x7f89fc13a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89fc1e06e0 0x7f89fc13a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fb7fe640 1 -- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e40047c0 msgr2=0x7f89fc147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e40047c0 0x7f89fc147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fb7fe640 1 -- 172.21.15.6:0/3039616869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc1e3da0 con 0x7f89fc1e3560 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89fb7fe640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 0x7f89fc1e01a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89f0001930 tx=0x7f89f002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f003c040 con 0x7f89fc1e3560 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f002cca0 con 0x7f89fc1e3560 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0007270 con 0x7f89fc1e3560 2023-12-19T13:33:01.325 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc14df20 con 0x7f89fc1e3560 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.318+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc13ab10 con 0x7f89fc1e3560 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.319+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc1e3c00 con 0x7f89fc1e3560 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.320+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89f0032070 con 0x7f89fc1e3560 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.320+0000 7f89f8ff9640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89e806a460 0x7f89e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.320+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89f00a9a50 con 0x7f89fc1e3560 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.320+0000 7f89fbfff640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89e806a460 0x7f89e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.321+0000 7f89fbfff640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89e806a460 0x7f89e806c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009c40 tx=0x7f89ec009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.326 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.325+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89fc1e3c00 con 0x7f89fc1e3560 2023-12-19T13:33:01.505 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.503+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89fc1e3c00 con 0x7f89fc1e3560 2023-12-19T13:33:01.506 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.503+0000 7f89f8ff9640 1 -- 172.21.15.6:0/3039616869 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12286 (secure 0 0 0) 0x7f89fc1e3c00 con 0x7f89fc1e3560 2023-12-19T13:33:01.506 INFO:teuthology.misc.health.smithi006.stdout: 2023-12-19T13:33:01.506 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":16,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:32:58.119371+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89e806a460 msgr2=0x7f89e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89e806a460 0x7f89e806c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009c40 tx=0x7f89ec009190 comp rx=0 tx=0).stop 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 msgr2=0x7f89fc1e01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 0x7f89fc1e01a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89f0001930 tx=0x7f89f002e070 comp rx=0 tx=0).stop 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 shutdown_connections 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89e806a460 0x7f89e806c920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89fc1e06e0 0x7f89fc13a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc1e3560 0x7f89fc1e01a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.508 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 --2- 172.21.15.6:0/3039616869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e40047c0 0x7f89fc147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.509 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.505+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 >> 172.21.15.6:0/3039616869 conn(0x7f89fc0c05b0 msgr2=0x7f89fc143de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:01.509 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.506+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 shutdown_connections 2023-12-19T13:33:01.509 INFO:teuthology.misc.health.smithi006.stderr:2023-12-19T13:33:01.506+0000 7f8a02877640 1 -- 172.21.15.6:0/3039616869 wait complete. 2023-12-19T13:33:01.517 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T13:33:01.517 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T13:33:01.518 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:33:01.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:33:01.520 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:33:01.521 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:33:01.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:33:01.522 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:33:01.523 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:33:01.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:33:01.525 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:33:01.526 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T13:33:01.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:01.603 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-12-19T13:33:01.603 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-12-19T13:33:01.610 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-19T13:33:01.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.634+0000 7f392194e640 1 Processor -- start 2023-12-19T13:33:01.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.634+0000 7f392194e640 1 -- start start 2023-12-19T13:33:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f392194e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c0ba290 0x7f391c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f392194e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f391c06f420 0x7f391c155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f392194e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c06b820 con 0x7f391c06d770 2023-12-19T13:33:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f392194e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c06de60 con 0x7f391c06f420 2023-12-19T13:33:01.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f392194e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c06eac0 con 0x7f391c0ba290 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f391c06f420 0x7f391c155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391affd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c0ba290 0x7f391c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f391c06f420 0x7f391c155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:52128/0 (socket says 172.21.15.6:52128) 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 -- 172.21.15.6:0/3966078929 learned_addr learned my addr 172.21.15.6:0/3966078929 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391a7fc640 1 --1- 172.21.15.6:0/3966078929 >> v1:172.21.15.89:6789/0 conn(0x7f391c06d770 0x7f391c14aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:49150/0 (socket says 172.21.15.6:49150) 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 -- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c0ba290 msgr2=0x7f391c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 --2- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c0ba290 0x7f391c06eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 -- 172.21.15.6:0/3966078929 >> v1:172.21.15.89:6789/0 conn(0x7f391c06d770 legacy=0x7f391c14aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f391b7fe640 1 -- 172.21.15.6:0/3966078929 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c06aef0 con 0x7f391c06f420 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.635+0000 7f3919ffb640 1 -- 172.21.15.6:0/3966078929 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955069942 0 0) 0x7f391c06b820 con 0x7f391c06d770 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.636+0000 7f391b7fe640 1 --2- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c06f420 0x7f391c155420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3914009e50 tx=0x7f391402bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ffa62b43f05d65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.636+0000 7f3919ffb640 1 -- 172.21.15.6:0/3966078929 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391402cb90 con 0x7f391c06f420 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.636+0000 7f3919ffb640 1 -- 172.21.15.6:0/3966078929 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391402ccf0 con 0x7f391c06f420 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.636+0000 7f3919ffb640 1 -- 172.21.15.6:0/3966078929 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914034610 con 0x7f391c06f420 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 -- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c06f420 msgr2=0x7f391c155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 --2- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c06f420 0x7f391c155420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3914009e50 tx=0x7f391402bff0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 -- 172.21.15.6:0/3966078929 shutdown_connections 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 --2- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c06f420 0x7f391c155420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 --2- 172.21.15.6:0/3966078929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c0ba290 0x7f391c06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 -- 172.21.15.6:0/3966078929 >> 172.21.15.6:0/3966078929 conn(0x7f391c0bac30 msgr2=0x7f391c0bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 -- 172.21.15.6:0/3966078929 shutdown_connections 2023-12-19T13:33:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.637+0000 7f392194e640 1 -- 172.21.15.6:0/3966078929 wait complete. 2023-12-19T13:33:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.638+0000 7f392194e640 1 Processor -- start 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.638+0000 7f392194e640 1 -- start start 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f392194e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c06d770 0x7f391c09d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f392194e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 0x7f391c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f392194e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c0ba290 0x7f391c1e0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f392194e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c142ce0 con 0x7f391c06f420 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f392194e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c09efd0 con 0x7f391c0ba290 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f392194e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c09db80 con 0x7f391c06d770 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 0x7f391c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 0x7f391c1427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46182/0 (socket says 172.21.15.6:46182) 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 -- 172.21.15.6:0/1998691905 learned_addr learned my addr 172.21.15.6:0/1998691905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391affd640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c06d770 0x7f391c09d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391b7fe640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c0ba290 0x7f391c1e0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 -- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c06d770 msgr2=0x7f391c09d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c06d770 0x7f391c09d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 -- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c0ba290 msgr2=0x7f391c1e0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c0ba290 0x7f391c1e0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 -- 172.21.15.6:0/1998691905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009b30 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f391a7fc640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 0x7f391c1427a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f391000c430 tx=0x7f391000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.639+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100074e0 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.640+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910007660 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.640+0000 7f392194e640 1 -- 172.21.15.6:0/1998691905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c1e0030 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.640+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910004a20 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.640+0000 7f392194e640 1 -- 172.21.15.6:0/1998691905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c09de60 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.640+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c06e5b0 con 0x7f391c06f420 2023-12-19T13:33:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.641+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3910004b80 con 0x7f391c06f420 2023-12-19T13:33:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.642+0000 7f3903fff640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f390806a430 0x7f390806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.642+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3910088320 con 0x7f391c06f420 2023-12-19T13:33:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.642+0000 7f391affd640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f390806a430 0x7f390806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.642+0000 7f391affd640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f390806a430 0x7f390806c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f390c009b40 tx=0x7f390c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.646+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3910053c80 con 0x7f391c06f420 2023-12-19T13:33:01.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.822+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f391c073a40 con 0x7f391c06f420 2023-12-19T13:33:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.823+0000 7f3903fff640 1 -- 172.21.15.6:0/1998691905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12286 (secure 0 0 0) 0x7f39100572a0 con 0x7f391c06f420 2023-12-19T13:33:01.825 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:01.825 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:32:58.119371+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f390806a430 msgr2=0x7f390806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f390806a430 0x7f390806c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f390c009b40 tx=0x7f390c009190 comp rx=0 tx=0).stop 2023-12-19T13:33:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 msgr2=0x7f391c1427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 0x7f391c1427a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f391000c430 tx=0x7f391000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 shutdown_connections 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f390806a430 0x7f390806c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f391c0ba290 0x7f391c1e0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f391c06f420 0x7f391c1427a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 --2- 172.21.15.6:0/1998691905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f391c06d770 0x7f391c09d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 >> 172.21.15.6:0/1998691905 conn(0x7f391c0bac30 msgr2=0x7f391c0b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 shutdown_connections 2023-12-19T13:33:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.825+0000 7f3901ffb640 1 -- 172.21.15.6:0/1998691905 wait complete. 2023-12-19T13:33:01.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:01.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f43152af640 1 Processor -- start 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f43152af640 1 -- start start 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f43152af640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 0x7f431014e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f43152af640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431009e4a0 con 0x7f431014eae0 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f43152af640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43100b13e0 con 0x7f43100b9850 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f43152af640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431014ef50 con 0x7f43100b8520 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.945+0000 7f430f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f431014eae0 0x7f4310155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59138/0 (socket says 172.21.15.6:59138) 2023-12-19T13:33:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430f7fe640 1 -- 172.21.15.6:0/4034924709 learned_addr learned my addr 172.21.15.6:0/4034924709 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f4307fff640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 0x7f431014e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425781930 0 0) 0x7f4308001490 con 0x7f431014eae0 2023-12-19T13:33:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42fc003520 con 0x7f431014eae0 2023-12-19T13:33:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293007082 0 0) 0x7f42fc003520 con 0x7f431014eae0 2023-12-19T13:33:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 msgr2=0x7f431014e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 0x7f431014e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 >> v1:172.21.15.89:6789/0 conn(0x7f43100b9850 legacy=0x7f4310144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310145340 con 0x7f431014eae0 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f4308001b80 con 0x7f431014eae0 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 >> v1:172.21.15.6:6789/0 conn(0x7f431014eae0 legacy=0x7f4310155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42fc0039a0 0x7f42fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0047c0 0x7f42fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 0x7f42fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431014ef50 con 0x7f42fc0039a0 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc00bae0 con 0x7f42fc0047c0 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc00bca0 con 0x7f43100b8520 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430effd640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42fc0039a0 0x7f42fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f4307fff640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0047c0 0x7f42fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.946+0000 7f430f7fe640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 0x7f42fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430effd640 1 -- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 msgr2=0x7f42fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430effd640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43100b8520 0x7f42fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430effd640 1 -- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0047c0 msgr2=0x7f42fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430effd640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0047c0 0x7f42fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430effd640 1 -- 172.21.15.6:0/4034924709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc003520 con 0x7f42fc0039a0 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430effd640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42fc0039a0 0x7f42fc003dc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4300001750 tx=0x7f42fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a5cec310bd4d43 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000052d0 con 0x7f42fc0039a0 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430002e050 con 0x7f42fc0039a0 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.947+0000 7f430e7fc640 1 -- 172.21.15.6:0/4034924709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000035f0 con 0x7f42fc0039a0 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f43152af640 1 -- 172.21.15.6:0/4034924709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42fc0039a0 msgr2=0x7f42fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f43152af640 1 --2- 172.21.15.6:0/4034924709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42fc0039a0 0x7f42fc003dc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4300001750 tx=0x7f42fc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f430f7fe640 1 -- 172.21.15.6:0/4034924709 reap_dead start 2023-12-19T13:33:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f43152af640 1 -- 172.21.15.6:0/4034924709 shutdown_connections 2023-12-19T13:33:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f43152af640 1 -- 172.21.15.6:0/4034924709 >> 172.21.15.6:0/4034924709 conn(0x7f43100bca80 msgr2=0x7f43100b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f43152af640 1 -- 172.21.15.6:0/4034924709 shutdown_connections 2023-12-19T13:33:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.948+0000 7f43152af640 1 -- 172.21.15.6:0/4034924709 wait complete. 2023-12-19T13:33:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.949+0000 7f43152af640 1 Processor -- start 2023-12-19T13:33:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.949+0000 7f43152af640 1 -- start start 2023-12-19T13:33:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43152af640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0039a0 0x7f43101473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43152af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 0x7f4310143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43152af640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4310143990 0x7f431013c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43152af640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310143e20 con 0x7f43101458c0 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43152af640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310142690 con 0x7f42fc0039a0 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43152af640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4310142970 con 0x7f4310143990 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 0x7f4310143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 0x7f4310143450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46204/0 (socket says 172.21.15.6:46204) 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 -- 172.21.15.6:0/473718722 learned_addr learned my addr 172.21.15.6:0/473718722 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f430f7fe640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4310143990 0x7f431013c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f430effd640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0039a0 0x7f43101473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 -- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4310143990 msgr2=0x7f431013c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4310143990 0x7f431013c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 -- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0039a0 msgr2=0x7f43101473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0039a0 0x7f43101473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 -- 172.21.15.6:0/473718722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310142c50 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f4307fff640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 0x7f4310143450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42f8011940 tx=0x7f42f8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8004240 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.950+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f80043c0 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.951+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4310142f30 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.951+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800faa0 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.951+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4310148c90 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.952+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310073a40 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.952+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42f800fc00 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.952+0000 7f43077fe640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f42f006a460 0x7f42f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.952+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42f8088a80 con 0x7f43101458c0 2023-12-19T13:33:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.952+0000 7f430effd640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f42f006a460 0x7f42f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.953+0000 7f430effd640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f42f006a460 0x7f42f006c920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4300033000 tx=0x7f4300009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:01.956+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f42f8054470 con 0x7f43101458c0 2023-12-19T13:33:02.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.132+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f431009eee0 con 0x7f43101458c0 2023-12-19T13:33:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.132+0000 7f43077fe640 1 -- 172.21.15.6:0/473718722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42f80190a0 con 0x7f43101458c0 2023-12-19T13:33:02.135 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f42f006a460 msgr2=0x7f42f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f42f006a460 0x7f42f006c920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4300033000 tx=0x7f4300009030 comp rx=0 tx=0).stop 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 msgr2=0x7f4310143450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 0x7f4310143450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42f8011940 tx=0x7f42f8011e00 comp rx=0 tx=0).stop 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 shutdown_connections 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f42f006a460 0x7f42f006c920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4310143990 0x7f431013c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43101458c0 0x7f4310143450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 --2- 172.21.15.6:0/473718722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42fc0039a0 0x7f43101473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 >> 172.21.15.6:0/473718722 conn(0x7f43100bca80 msgr2=0x7f431006c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:02.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 shutdown_connections 2023-12-19T13:33:02.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.135+0000 7f43152af640 1 -- 172.21.15.6:0/473718722 wait complete. 2023-12-19T13:33:02.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.251+0000 7fe0837c9640 1 Processor -- start 2023-12-19T13:33:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.251+0000 7fe0837c9640 1 -- start start 2023-12-19T13:33:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe0837c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c0b8150 0x7fe07c0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:02.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe0837c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe07c149260 0x7fe07c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe0837c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0716b0 con 0x7fe07c06a120 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe0837c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0b4070 con 0x7fe07c149260 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe0837c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b3430 con 0x7fe07c0b8150 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081d66640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe07c149260 0x7fe07c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe080d64640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe07c06a120 0x7fe07c148b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:49166/0 (socket says 172.21.15.6:49166) 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe080d64640 1 -- 172.21.15.6:0/3417561683 learned_addr learned my addr 172.21.15.6:0/3417561683 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081565640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c0b8150 0x7fe07c0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081d66640 1 -- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c0b8150 msgr2=0x7fe07c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081d66640 1 --2- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c0b8150 0x7fe07c0b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081d66640 1 -- 172.21.15.6:0/3417561683 >> v1:172.21.15.89:6789/0 conn(0x7fe07c06a120 legacy=0x7fe07c148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081d66640 1 -- 172.21.15.6:0/3417561683 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0b58a0 con 0x7fe07c149260 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe073fff640 1 -- 172.21.15.6:0/3417561683 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221564609 0 0) 0x7fe07c0716b0 con 0x7fe07c06a120 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.252+0000 7fe081565640 1 --2- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c0b8150 0x7fe07c0b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.253+0000 7fe081d66640 1 --2- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1532e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe074009d90 tx=0x7fe07402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a669d884446d01a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.253+0000 7fe073fff640 1 -- 172.21.15.6:0/3417561683 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07402cbc0 con 0x7fe07c149260 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.253+0000 7fe073fff640 1 -- 172.21.15.6:0/3417561683 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07402cd20 con 0x7fe07c149260 2023-12-19T13:33:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.253+0000 7fe073fff640 1 -- 172.21.15.6:0/3417561683 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074034660 con 0x7fe07c149260 2023-12-19T13:33:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 -- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 msgr2=0x7fe07c1532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 --2- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1532e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe074009d90 tx=0x7fe07402be10 comp rx=0 tx=0).stop 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 -- 172.21.15.6:0/3417561683 shutdown_connections 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 --2- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1532e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 --2- 172.21.15.6:0/3417561683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c0b8150 0x7fe07c0b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 -- 172.21.15.6:0/3417561683 >> 172.21.15.6:0/3417561683 conn(0x7fe07c0bc330 msgr2=0x7fe07c0bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 -- 172.21.15.6:0/3417561683 shutdown_connections 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.254+0000 7fe0837c9640 1 -- 172.21.15.6:0/3417561683 wait complete. 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.255+0000 7fe0837c9640 1 Processor -- start 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.255+0000 7fe0837c9640 1 -- start start 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c06a120 0x7fe07c14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 0x7fe07c1dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1ddd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c14c400 con 0x7fe07c0b8150 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0a7760 con 0x7fe07c149260 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b2920 con 0x7fe07c06a120 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 0x7fe07c1dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 0x7fe07c1dd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46214/0 (socket says 172.21.15.6:46214) 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 -- 172.21.15.6:0/56136301 learned_addr learned my addr 172.21.15.6:0/56136301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe081565640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c06a120 0x7fe07c14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe081d66640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1ddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 -- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c06a120 msgr2=0x7fe07c14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c06a120 0x7fe07c14bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 -- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 msgr2=0x7fe07c1ddd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1ddd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 -- 172.21.15.6:0/56136301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe078009400 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe080d64640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 0x7fe07c1dd7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c460 tx=0x7fe06c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0074e0 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c007660 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe074009a70 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.256+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004a20 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.257+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c0b2360 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.257+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c073a40 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.258+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe06c004b80 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.258+0000 7fe071ffb640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe06006a460 0x7fe06006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.258+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe06c087a00 con 0x7fe07c0b8150 2023-12-19T13:33:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.258+0000 7fe081565640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe06006a460 0x7fe06006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.259+0000 7fe081565640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe06006a460 0x7fe06006c920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe078009c60 tx=0x7fe078008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.262+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe06c053340 con 0x7fe07c0b8150 2023-12-19T13:33:02.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.473+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe07c147e70 con 0x7fe07c0b8150 2023-12-19T13:33:02.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.473+0000 7fe071ffb640 1 -- 172.21.15.6:0/56136301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7fe06c018090 con 0x7fe07c0b8150 2023-12-19T13:33:02.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:02.476 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-19T13:33:02.476 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe06006a460 msgr2=0x7fe06006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe06006a460 0x7fe06006c920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe078009c60 tx=0x7fe078008040 comp rx=0 tx=0).stop 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 msgr2=0x7fe07c1dd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 0x7fe07c1dd7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c460 tx=0x7fe06c00c920 comp rx=0 tx=0).stop 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 shutdown_connections 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe06006a460 0x7fe06006c920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe07c149260 0x7fe07c1ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0b8150 0x7fe07c1dd7f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 --2- 172.21.15.6:0/56136301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe07c06a120 0x7fe07c14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:02.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.475+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 >> 172.21.15.6:0/56136301 conn(0x7fe07c0bc330 msgr2=0x7fe07c1424c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:02.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.476+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 shutdown_connections 2023-12-19T13:33:02.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:02.476+0000 7fe0837c9640 1 -- 172.21.15.6:0/56136301 wait complete. 2023-12-19T13:33:04.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:04.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.606+0000 7f3f12238640 1 Processor -- start 2023-12-19T13:33:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.606+0000 7f3f12238640 1 -- start start 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f12238640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f0c1544e0 0x7f3f0c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f12238640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0bb310 con 0x7f3f0c0ba550 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f12238640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0bf960 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f12238640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0bb5b0 con 0x7f3f0c1544e0 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f0affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f0c0ba550 0x7f3f0c0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59148/0 (socket says 172.21.15.6:59148) 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f0affd640 1 -- 172.21.15.6:0/2003543104 learned_addr learned my addr 172.21.15.6:0/2003543104 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f0bfff640 1 --2- 172.21.15.6:0/2003543104 >> v2:172.21.15.89:3300/0 conn(0x7f3f0c1544e0 0x7f3f0c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f0a7fc640 1 -- 172.21.15.6:0/2003543104 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311120503 0 0) 0x7f3f0c0bb310 con 0x7f3f0c0ba550 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f0a7fc640 1 -- 172.21.15.6:0/2003543104 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef4003520 con 0x7f3f0c0ba550 2023-12-19T13:33:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.607+0000 7f3f0bfff640 1 -- 172.21.15.6:0/2003543104 >> v1:172.21.15.89:6789/0 conn(0x7f3f0c06a6d0 legacy=0x7f3f0c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.608+0000 7f3f0a7fc640 1 -- 172.21.15.6:0/2003543104 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978240001 0 0) 0x7f3f0c0bf960 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.608+0000 7f3f0bfff640 1 -- 172.21.15.6:0/2003543104 >> v1:172.21.15.6:6789/0 conn(0x7f3f0c0ba550 legacy=0x7f3f0c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.608+0000 7f3f0bfff640 1 -- 172.21.15.6:0/2003543104 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0c0120 con 0x7f3f0c1544e0 2023-12-19T13:33:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.608+0000 7f3f0bfff640 1 --2- 172.21.15.6:0/2003543104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c1544e0 0x7f3f0c1568d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009d90 tx=0x7f3f0402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b8bf523b50fbe8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f0a7fc640 1 -- 172.21.15.6:0/2003543104 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0402cd00 con 0x7f3f0c1544e0 2023-12-19T13:33:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f0a7fc640 1 -- 172.21.15.6:0/2003543104 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0402ce60 con 0x7f3f0c1544e0 2023-12-19T13:33:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f0a7fc640 1 -- 172.21.15.6:0/2003543104 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04034660 con 0x7f3f0c1544e0 2023-12-19T13:33:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 -- 172.21.15.6:0/2003543104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c1544e0 msgr2=0x7f3f0c1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 --2- 172.21.15.6:0/2003543104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c1544e0 0x7f3f0c1568d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009d90 tx=0x7f3f0402bf50 comp rx=0 tx=0).stop 2023-12-19T13:33:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 -- 172.21.15.6:0/2003543104 shutdown_connections 2023-12-19T13:33:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 --2- 172.21.15.6:0/2003543104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c1544e0 0x7f3f0c1568d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 -- 172.21.15.6:0/2003543104 >> 172.21.15.6:0/2003543104 conn(0x7f3f0c0c0350 msgr2=0x7f3f0c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 -- 172.21.15.6:0/2003543104 shutdown_connections 2023-12-19T13:33:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.609+0000 7f3f12238640 1 -- 172.21.15.6:0/2003543104 wait complete. 2023-12-19T13:33:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.610+0000 7f3f12238640 1 Processor -- start 2023-12-19T13:33:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.610+0000 7f3f12238640 1 -- start start 2023-12-19T13:33:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f12238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 0x7f3f0c149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f12238640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c0ba550 0x7f3f0c0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f12238640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f0c1544e0 0x7f3f0c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f12238640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c143df0 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f12238640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0a15f0 con 0x7f3f0c0ba550 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f12238640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0a1840 con 0x7f3f0c1544e0 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 0x7f3f0c149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 0x7f3f0c149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46226/0 (socket says 172.21.15.6:46226) 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 -- 172.21.15.6:0/254146798 learned_addr learned my addr 172.21.15.6:0/254146798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0affd640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c0ba550 0x7f3f0c0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0bfff640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f0c1544e0 0x7f3f0c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 -- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f0c1544e0 msgr2=0x7f3f0c0b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f0c1544e0 0x7f3f0c0b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 -- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c0ba550 msgr2=0x7f3f0c0b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.611+0000 7f3f0b7fe640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c0ba550 0x7f3f0c0b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3f0b7fe640 1 -- 172.21.15.6:0/254146798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04009a70 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3f0b7fe640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 0x7f3f0c149520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c4e0 tx=0x7f3efc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc005480 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0035f0 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c0b53a0 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0039c0 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.612+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c0b5630 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.613+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0b5820 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.613+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3efc003b20 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.614+0000 7f3ef3fff640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ef806a430 0x7f3ef806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.614+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3efc087b40 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.614+0000 7f3f0affd640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ef806a430 0x7f3ef806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.614+0000 7f3f0affd640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ef806a430 0x7f3ef806c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c145bc0 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:04.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.618+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3efc053490 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.830+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f0c073a40 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.831+0000 7f3ef3fff640 1 -- 172.21.15.6:0/254146798 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2759 (secure 0 0 0) 0x7f3efc017ae0 con 0x7f3f0c06a6d0 2023-12-19T13:33:04.832 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:04.832 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T13:33:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ef806a430 msgr2=0x7f3ef806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ef806a430 0x7f3ef806c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c145bc0 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 msgr2=0x7f3f0c149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 0x7f3f0c149520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c4e0 tx=0x7f3efc00c9a0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 shutdown_connections 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3ef806a430 0x7f3ef806c8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f0c1544e0 0x7f3f0c0b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f0c0ba550 0x7f3f0c0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 --2- 172.21.15.6:0/254146798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f0c06a6d0 0x7f3f0c149520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 >> 172.21.15.6:0/254146798 conn(0x7f3f0c0c0350 msgr2=0x7f3f0c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 shutdown_connections 2023-12-19T13:33:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.833+0000 7f3f12238640 1 -- 172.21.15.6:0/254146798 wait complete. 2023-12-19T13:33:04.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.949+0000 7f6707992640 1 Processor -- start 2023-12-19T13:33:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.949+0000 7f6707992640 1 -- start start 2023-12-19T13:33:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f6707992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67000ba290 0x7f670006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f6707992640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006d770 0x7f670014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f6707992640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670006b820 con 0x7f670006f420 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f6707992640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670006de60 con 0x7f67000ba290 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f6707992640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670006eac0 con 0x7f670006d770 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f670572e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67000ba290 0x7f670006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f670572e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67000ba290 0x7f670006eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46240/0 (socket says 172.21.15.6:46240) 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f670572e640 1 -- 172.21.15.6:0/4180492435 learned_addr learned my addr 172.21.15.6:0/4180492435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f6704f2d640 1 --2- 172.21.15.6:0/4180492435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006d770 0x7f670014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.950+0000 7f670572e640 1 -- 172.21.15.6:0/4180492435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006d770 msgr2=0x7f670014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f670572e640 1 --2- 172.21.15.6:0/4180492435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006d770 0x7f670014aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f670572e640 1 -- 172.21.15.6:0/4180492435 >> v1:172.21.15.6:6789/0 conn(0x7f670006f420 legacy=0x7f670014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f670572e640 1 -- 172.21.15.6:0/4180492435 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670006aef0 con 0x7f67000ba290 2023-12-19T13:33:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f670572e640 1 --2- 172.21.15.6:0/4180492435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670006eee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009e50 tx=0x7f66f802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bde4386cacdf843 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f66f7fff640 1 -- 172.21.15.6:0/4180492435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f802cb90 con 0x7f67000ba290 2023-12-19T13:33:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f66f7fff640 1 -- 172.21.15.6:0/4180492435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f802ccf0 con 0x7f67000ba290 2023-12-19T13:33:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.951+0000 7f66f7fff640 1 -- 172.21.15.6:0/4180492435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8034610 con 0x7f67000ba290 2023-12-19T13:33:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 -- 172.21.15.6:0/4180492435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 msgr2=0x7f670006eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 --2- 172.21.15.6:0/4180492435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670006eee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009e50 tx=0x7f66f802bff0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 -- 172.21.15.6:0/4180492435 shutdown_connections 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 --2- 172.21.15.6:0/4180492435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006d770 0x7f670014aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 --2- 172.21.15.6:0/4180492435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670006eee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 -- 172.21.15.6:0/4180492435 >> 172.21.15.6:0/4180492435 conn(0x7f67000bac30 msgr2=0x7f67000bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 -- 172.21.15.6:0/4180492435 shutdown_connections 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.952+0000 7f6707992640 1 -- 172.21.15.6:0/4180492435 wait complete. 2023-12-19T13:33:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.953+0000 7f6707992640 1 Processor -- start 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.953+0000 7f6707992640 1 -- start start 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f670006d770 0x7f67001d6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006f420 0x7f6700142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700141ec0 con 0x7f67000ba290 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700143ef0 con 0x7f670006d770 2023-12-19T13:33:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67001d7400 con 0x7f670006f420 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670014a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46248/0 (socket says 172.21.15.6:46248) 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 -- 172.21.15.6:0/2656934257 learned_addr learned my addr 172.21.15.6:0/2656934257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6704f2d640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006f420 0x7f6700142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f670572e640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f670006d770 0x7f67001d6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 -- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006f420 msgr2=0x7f6700142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006f420 0x7f6700142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 -- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f670006d770 msgr2=0x7f67001d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f670006d770 0x7f67001d6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 -- 172.21.15.6:0/2656934257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8009b30 con 0x7f67000ba290 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6704f2d640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006f420 0x7f6700142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6705f2f640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670014a510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c400 tx=0x7f66fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0052d0 con 0x7f67000ba290 2023-12-19T13:33:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc005430 con 0x7f67000ba290 2023-12-19T13:33:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc003810 con 0x7f67000ba290 2023-12-19T13:33:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.954+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67001413e0 con 0x7f67000ba290 2023-12-19T13:33:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.955+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6700142a40 con 0x7f67000ba290 2023-12-19T13:33:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.956+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670006e5b0 con 0x7f67000ba290 2023-12-19T13:33:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.956+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66fc003970 con 0x7f67000ba290 2023-12-19T13:33:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.956+0000 7f66f5ffb640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f66e406a430 0x7f66e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.957+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66fc087aa0 con 0x7f67000ba290 2023-12-19T13:33:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.957+0000 7f670572e640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f66e406a430 0x7f66e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.957+0000 7f670572e640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f66e406a430 0x7f66e406c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66f8035000 tx=0x7f66f8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:04.961+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f66fc053470 con 0x7f67000ba290 2023-12-19T13:33:05.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.139+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6700141be0 con 0x7f67000ba290 2023-12-19T13:33:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.140+0000 7f66f5ffb640 1 -- 172.21.15.6:0/2656934257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12286 (secure 0 0 0) 0x7f66fc056a90 con 0x7f67000ba290 2023-12-19T13:33:05.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:05.141 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:32:58.119371+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f66e406a430 msgr2=0x7f66e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f66e406a430 0x7f66e406c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66f8035000 tx=0x7f66f8030000 comp rx=0 tx=0).stop 2023-12-19T13:33:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 msgr2=0x7f670014a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670014a510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c400 tx=0x7f66fc00c8c0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 shutdown_connections 2023-12-19T13:33:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f66e406a430 0x7f66e406c8f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000ba290 0x7f670014a510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f670006f420 0x7f6700142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 --2- 172.21.15.6:0/2656934257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f670006d770 0x7f67001d6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 >> 172.21.15.6:0/2656934257 conn(0x7f67000bac30 msgr2=0x7f67000a1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 shutdown_connections 2023-12-19T13:33:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.142+0000 7f6707992640 1 -- 172.21.15.6:0/2656934257 wait complete. 2023-12-19T13:33:05.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:05.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:05.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.261+0000 7f8e0314e640 1 Processor -- start 2023-12-19T13:33:05.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.261+0000 7f8e0314e640 1 -- start start 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e0314e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8dfc06b9d0 0x7f8dfc06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e0314e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc153480 0x7f8dfc155870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e0314e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc06eae0 con 0x7f8dfc06bdb0 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e0314e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc06cee0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e0314e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc14e100 con 0x7f8dfc153480 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e00eea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8dfc06b9d0 0x7f8dfc06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e016eb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc153480 0x7f8dfc155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e00eea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8dfc06b9d0 0x7f8dfc06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:52190/0 (socket says 172.21.15.6:52190) 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8dfbfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8dfc06bdb0 0x7f8dfc06ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:49192/0 (socket says 172.21.15.6:49192) 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.262+0000 7f8e00eea640 1 -- 172.21.15.6:0/1564450281 learned_addr learned my addr 172.21.15.6:0/1564450281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8e00eea640 1 -- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc153480 msgr2=0x7f8dfc155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8e00eea640 1 --2- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc153480 0x7f8dfc155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8e00eea640 1 -- 172.21.15.6:0/1564450281 >> v1:172.21.15.89:6789/0 conn(0x7f8dfc06bdb0 legacy=0x7f8dfc06ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8e00eea640 1 -- 172.21.15.6:0/1564450281 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc06e6c0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8dfb7fe640 1 -- 172.21.15.6:0/1564450281 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183162571 0 0) 0x7f8dfc06eae0 con 0x7f8dfc06bdb0 2023-12-19T13:33:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8e016eb640 1 --2- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc153480 0x7f8dfc155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.263+0000 7f8e00eea640 1 --2- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc06c9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009e50 tx=0x7f8df402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f43584ba7a679a0b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8dfb7fe640 1 -- 172.21.15.6:0/1564450281 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df402cb00 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8dfb7fe640 1 -- 172.21.15.6:0/1564450281 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df402cc60 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8dfb7fe640 1 -- 172.21.15.6:0/1564450281 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df40343f0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 -- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc06b9d0 msgr2=0x7f8dfc06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 --2- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc06c9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009e50 tx=0x7f8df402bf60 comp rx=0 tx=0).stop 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 -- 172.21.15.6:0/1564450281 shutdown_connections 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 --2- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc153480 0x7f8dfc155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 --2- 172.21.15.6:0/1564450281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc06c9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 -- 172.21.15.6:0/1564450281 >> 172.21.15.6:0/1564450281 conn(0x7f8dfc0be1e0 msgr2=0x7f8dfc0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 -- 172.21.15.6:0/1564450281 shutdown_connections 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.264+0000 7f8e0314e640 1 -- 172.21.15.6:0/1564450281 wait complete. 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.265+0000 7f8e0314e640 1 Processor -- start 2023-12-19T13:33:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.265+0000 7f8e0314e640 1 -- start start 2023-12-19T13:33:05.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e0314e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e0314e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc06bdb0 0x7f8dfc0a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e0314e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc153480 0x7f8dfc14d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e0314e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc14b430 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e0314e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1475f0 con 0x7f8dfc153480 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e0314e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1454c0 con 0x7f8dfc06bdb0 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc1470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46250/0 (socket says 172.21.15.6:46250) 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 -- 172.21.15.6:0/2361122490 learned_addr learned my addr 172.21.15.6:0/2361122490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8dfbfff640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc06bdb0 0x7f8dfc0a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e016eb640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc153480 0x7f8dfc14d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 -- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc06bdb0 msgr2=0x7f8dfc0a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc06bdb0 0x7f8dfc0a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 -- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc153480 msgr2=0x7f8dfc14d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc153480 0x7f8dfc14d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.266+0000 7f8e00eea640 1 -- 172.21.15.6:0/2361122490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009400 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.267+0000 7f8e00eea640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc1470b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8df4036040 tx=0x7f8df4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.267+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4009510 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.267+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df403e450 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.267+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df4009b30 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.267+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df403e7e0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.267+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc14b6d0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.268+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc066e90 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.268+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8df403e940 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.269+0000 7f8df97fa640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ddc06a430 0x7f8ddc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.269+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8df40ab1d0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.269+0000 7f8dfbfff640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ddc06a430 0x7f8ddc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.270+0000 7f8dfbfff640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ddc06a430 0x7f8ddc06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc145700 tx=0x7f8dec007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.273+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8df4076bd0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.450+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8dfc073a40 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.451+0000 7f8df97fa640 1 -- 172.21.15.6:0/2361122490 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8df407a1f0 con 0x7f8dfc06b9d0 2023-12-19T13:33:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ddc06a430 msgr2=0x7f8ddc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ddc06a430 0x7f8ddc06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc145700 tx=0x7f8dec007d50 comp rx=0 tx=0).stop 2023-12-19T13:33:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 msgr2=0x7f8dfc1470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc1470b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8df4036040 tx=0x7f8df4004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 shutdown_connections 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ddc06a430 0x7f8ddc06c8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dfc153480 0x7f8dfc14d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dfc06bdb0 0x7f8dfc0a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 --2- 172.21.15.6:0/2361122490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc06b9d0 0x7f8dfc1470b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 >> 172.21.15.6:0/2361122490 conn(0x7f8dfc0be1e0 msgr2=0x7f8dfc06ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 shutdown_connections 2023-12-19T13:33:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.453+0000 7f8e0314e640 1 -- 172.21.15.6:0/2361122490 wait complete. 2023-12-19T13:33:05.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:33:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.569+0000 7f0c16ee5640 1 Processor -- start 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.569+0000 7f0c16ee5640 1 -- start start 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c16ee5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c100b79f0 0x7f0c100bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c16ee5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c1014aa00 0x7f0c100b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c16ee5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c10140ef0 0x7f0c10141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c16ee5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c100bbca0 con 0x7f0c1014aa00 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c16ee5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c101418c0 con 0x7f0c10140ef0 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c16ee5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100bacc0 con 0x7f0c100b79f0 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c1014aa00 0x7f0c100b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c1014aa00 0x7f0c100b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46256/0 (socket says 172.21.15.6:46256) 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 -- 172.21.15.6:0/380817180 learned_addr learned my addr 172.21.15.6:0/380817180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c14c81640 1 --2- 172.21.15.6:0/380817180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c100b79f0 0x7f0c100bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c15482640 1 --2- 172.21.15.6:0/380817180 >> v2:172.21.15.89:3300/0 conn(0x7f0c10140ef0 0x7f0c10141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 -- 172.21.15.6:0/380817180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c100b79f0 msgr2=0x7f0c100bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 --2- 172.21.15.6:0/380817180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c100b79f0 0x7f0c100bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 -- 172.21.15.6:0/380817180 >> v2:172.21.15.89:3300/0 conn(0x7f0c10140ef0 msgr2=0x7f0c10141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 --2- 172.21.15.6:0/380817180 >> v2:172.21.15.89:3300/0 conn(0x7f0c10140ef0 0x7f0c10141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c0ffff640 1 -- 172.21.15.6:0/380817180 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c100bbe60 con 0x7f0c1014aa00 2023-12-19T13:33:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.570+0000 7f0c15482640 1 --2- 172.21.15.6:0/380817180 >> v2:172.21.15.89:3300/0 conn(0x7f0c10140ef0 0x7f0c10141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.571+0000 7f0c0ffff640 1 --2- 172.21.15.6:0/380817180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c1014aa00 0x7f0c100b83a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c10145020 tx=0x7f0c0002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87419726a950bae9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.571+0000 7f0c0f7fe640 1 -- 172.21.15.6:0/380817180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c00030850 con 0x7f0c1014aa00 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.571+0000 7f0c0f7fe640 1 -- 172.21.15.6:0/380817180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c000309b0 con 0x7f0c1014aa00 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.571+0000 7f0c0f7fe640 1 -- 172.21.15.6:0/380817180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c00030d40 con 0x7f0c1014aa00 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 -- 172.21.15.6:0/380817180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c1014aa00 msgr2=0x7f0c100b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/380817180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c1014aa00 0x7f0c100b83a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c10145020 tx=0x7f0c0002b990 comp rx=0 tx=0).stop 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 -- 172.21.15.6:0/380817180 shutdown_connections 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/380817180 >> v2:172.21.15.89:3300/0 conn(0x7f0c10140ef0 0x7f0c10141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/380817180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c1014aa00 0x7f0c100b83a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/380817180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c100b79f0 0x7f0c100bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 -- 172.21.15.6:0/380817180 >> 172.21.15.6:0/380817180 conn(0x7f0c100c0340 msgr2=0x7f0c100c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 -- 172.21.15.6:0/380817180 shutdown_connections 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.572+0000 7f0c16ee5640 1 -- 172.21.15.6:0/380817180 wait complete. 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.573+0000 7f0c16ee5640 1 Processor -- start 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.573+0000 7f0c16ee5640 1 -- start start 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.573+0000 7f0c16ee5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 0x7f0c100bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c10140ef0 0x7f0c101df670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1014aa00 0x7f0c1014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100bfa50 con 0x7f0c100b79f0 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101e2ce0 con 0x7f0c10140ef0 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101e2fc0 con 0x7f0c1014aa00 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 0x7f0c100bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 0x7f0c100bf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46270/0 (socket says 172.21.15.6:46270) 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 -- 172.21.15.6:0/3130326862 learned_addr learned my addr 172.21.15.6:0/3130326862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c15482640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1014aa00 0x7f0c1014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c0ffff640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c10140ef0 0x7f0c101df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 -- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1014aa00 msgr2=0x7f0c1014bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1014aa00 0x7f0c1014bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 -- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c10140ef0 msgr2=0x7f0c101df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c10140ef0 0x7f0c101df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 -- 172.21.15.6:0/3130326862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000094d0 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c14c81640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 0x7f0c100bf510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800eed0 tx=0x7f0c0800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08010040 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08009e80 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c101e32a0 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08014620 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.574+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c101e3a80 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.575+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c10073a40 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.576+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c08014780 con 0x7f0c100b79f0 2023-12-19T13:33:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.576+0000 7f0c0d7fa640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0bf006a430 0x7f0bf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.576+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c08088c60 con 0x7f0c100b79f0 2023-12-19T13:33:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.576+0000 7f0c0ffff640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0bf006a430 0x7f0bf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.577+0000 7f0c0ffff640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0bf006a430 0x7f0bf006c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c00036000 tx=0x7f0c0003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.581+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c080545b0 con 0x7f0c100b79f0 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.763+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0c1013d7d0 con 0x7f0c100b79f0 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.763+0000 7f0c0d7fa640 1 -- 172.21.15.6:0/3130326862 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0c08057bd0 con 0x7f0c100b79f0 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-12-19T13:33:05.764 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-12-19T13:33:05.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:05.765 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-12-19T13:33:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0bf006a430 msgr2=0x7f0bf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0bf006a430 0x7f0bf006c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c00036000 tx=0x7f0c0003b040 comp rx=0 tx=0).stop 2023-12-19T13:33:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 msgr2=0x7f0c100bf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 0x7f0c100bf510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800eed0 tx=0x7f0c0800b480 comp rx=0 tx=0).stop 2023-12-19T13:33:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 shutdown_connections 2023-12-19T13:33:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0bf006a430 0x7f0bf006c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1014aa00 0x7f0c1014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c10140ef0 0x7f0c101df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 --2- 172.21.15.6:0/3130326862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c100b79f0 0x7f0c100bf510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 >> 172.21.15.6:0/3130326862 conn(0x7f0c100c0340 msgr2=0x7f0c1013f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 shutdown_connections 2023-12-19T13:33:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.765+0000 7f0c16ee5640 1 -- 172.21.15.6:0/3130326862 wait complete. 2023-12-19T13:33:05.776 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:33:05.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:33:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 Processor -- start 2023-12-19T13:33:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 -- start start 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72240b8690 0x7f72240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7224144d80 0x7f722414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722414ab10 con 0x7f72240b77d0 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722406c2f0 con 0x7f72240b8690 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.885+0000 7f7228ff6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72240ba620 con 0x7f7224144d80 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72240b8690 0x7f72240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72240b8690 0x7f72240b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46280/0 (socket says 172.21.15.6:46280) 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 -- 172.21.15.6:0/1734950061 learned_addr learned my addr 172.21.15.6:0/1734950061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f7222d9d640 1 --2- 172.21.15.6:0/1734950061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7224144d80 0x7f722414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 -- 172.21.15.6:0/1734950061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7224144d80 msgr2=0x7f722414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 --2- 172.21.15.6:0/1734950061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7224144d80 0x7f722414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 -- 172.21.15.6:0/1734950061 >> v1:172.21.15.89:6789/0 conn(0x7f72240b77d0 legacy=0x7f7224144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.886+0000 7f722259c640 1 -- 172.21.15.6:0/1734950061 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240b9e60 con 0x7f72240b8690 2023-12-19T13:33:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f722259c640 1 --2- 172.21.15.6:0/1734950061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72240b8690 0x7f72240b8a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7214009870 tx=0x7f721402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af469a5a4b67aea4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7221d9b640 1 -- 172.21.15.6:0/1734950061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214031640 con 0x7f72240b8690 2023-12-19T13:33:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7221d9b640 1 -- 172.21.15.6:0/1734950061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72140317a0 con 0x7f72240b8690 2023-12-19T13:33:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7221d9b640 1 -- 172.21.15.6:0/1734950061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214031b30 con 0x7f72240b8690 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 -- 172.21.15.6:0/1734950061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72240b8690 msgr2=0x7f72240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 --2- 172.21.15.6:0/1734950061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72240b8690 0x7f72240b8a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7214009870 tx=0x7f721402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 -- 172.21.15.6:0/1734950061 shutdown_connections 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 --2- 172.21.15.6:0/1734950061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7224144d80 0x7f722414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 --2- 172.21.15.6:0/1734950061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72240b8690 0x7f72240b8a70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 -- 172.21.15.6:0/1734950061 >> 172.21.15.6:0/1734950061 conn(0x7f722406b6a0 msgr2=0x7f722406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 -- 172.21.15.6:0/1734950061 shutdown_connections 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.887+0000 7f7228ff6640 1 -- 172.21.15.6:0/1734950061 wait complete. 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 Processor -- start 2023-12-19T13:33:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 -- start start 2023-12-19T13:33:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72240b77d0 0x7f7224148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72240b8690 0x7f7224147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 0x7f72241462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224149690 con 0x7f7224144d80 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224149e90 con 0x7f72240b8690 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.889+0000 7f7228ff6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722414a170 con 0x7f72240b77d0 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 0x7f72241462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 0x7f72241462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46294/0 (socket says 172.21.15.6:46294) 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 -- 172.21.15.6:0/645459756 learned_addr learned my addr 172.21.15.6:0/645459756 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f722259c640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72240b77d0 0x7f7224148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7219d9b640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72240b8690 0x7f7224147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 -- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72240b77d0 msgr2=0x7f7224148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72240b77d0 0x7f7224148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 -- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72240b8690 msgr2=0x7f7224147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72240b8690 0x7f7224147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 -- 172.21.15.6:0/645459756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140094d0 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f722259c640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72240b77d0 0x7f7224148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7219d9b640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72240b8690 0x7f7224147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7222d9d640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 0x7f72241462d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f721c007de0 tx=0x7f721c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c014620 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c00ee90 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722414a450 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c0149e0 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.890+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7224149ab0 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.891+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7224149cd0 con 0x7f7224144d80 2023-12-19T13:33:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.892+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f721c014b40 con 0x7f7224144d80 2023-12-19T13:33:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.892+0000 7f721b7fe640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f720406a430 0x7f720406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.892+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f721c088f70 con 0x7f7224144d80 2023-12-19T13:33:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.892+0000 7f722259c640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f720406a430 0x7f720406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.893+0000 7f722259c640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f720406a430 0x7f720406c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7214036000 tx=0x7f721403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:05.896+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f721c0bbc80 con 0x7f7224144d80 2023-12-19T13:33:06.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.073+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f722414a640 con 0x7f7224144d80 2023-12-19T13:33:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.649+0000 7f721b7fe640 1 -- 172.21.15.6:0/645459756 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f721c05e070 con 0x7f7224144d80 2023-12-19T13:33:06.650 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f720406a430 msgr2=0x7f720406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f720406a430 0x7f720406c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7214036000 tx=0x7f721403c040 comp rx=0 tx=0).stop 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 msgr2=0x7f72241462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 0x7f72241462d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f721c007de0 tx=0x7f721c00e4b0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 shutdown_connections 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f720406a430 0x7f720406c8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7224144d80 0x7f72241462d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72240b8690 0x7f7224147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 --2- 172.21.15.6:0/645459756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72240b77d0 0x7f7224148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 >> 172.21.15.6:0/645459756 conn(0x7f722406b6a0 msgr2=0x7f72240ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:06.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 shutdown_connections 2023-12-19T13:33:06.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.653+0000 7f7228ff6640 1 -- 172.21.15.6:0/645459756 wait complete. 2023-12-19T13:33:06.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:33:06.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.786+0000 7f05c8927640 1 Processor -- start 2023-12-19T13:33:06.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.786+0000 7f05c8927640 1 -- start start 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c8927640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 0x7f05c40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c8927640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f05c40b77d0 0x7f05c414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c8927640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c414ab10 con 0x7f05c40b8690 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c8927640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c406c2f0 con 0x7f05c40b77d0 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c8927640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40ba620 con 0x7f05c4144d80 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f05c40b8690 0x7f05c4144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56238/0 (socket says 172.21.15.6:56238) 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c259c640 1 -- 172.21.15.6:0/478273230 learned_addr learned my addr 172.21.15.6:0/478273230 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288390529 0 0) 0x7f05c414ab10 con 0x7f05c40b8690 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c2d9d640 1 --2- 172.21.15.6:0/478273230 >> v2:172.21.15.89:3300/0 conn(0x7f05c40b77d0 0x7f05c414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b0003520 con 0x7f05c40b8690 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.787+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 0x7f05c40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043529367 0 0) 0x7f05b0003520 con 0x7f05c40b8690 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 msgr2=0x7f05c40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 0x7f05c40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 >> v2:172.21.15.89:3300/0 conn(0x7f05c40b77d0 msgr2=0x7f05c414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 --2- 172.21.15.6:0/478273230 >> v2:172.21.15.89:3300/0 conn(0x7f05c40b77d0 0x7f05c414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40b9e60 con 0x7f05c40b8690 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f05bc001670 con 0x7f05c40b8690 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 >> v1:172.21.15.6:6789/0 conn(0x7f05c40b8690 legacy=0x7f05c4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 0x7f05b0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b0004d00 0x7f05b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c406c2f0 con 0x7f05b0003ef0 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40ba620 con 0x7f05b0004d00 2023-12-19T13:33:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b000b9d0 con 0x7f05c4144d80 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c259c640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 0x7f05b0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c2d9d640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b0004d00 0x7f05b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c1d9b640 1 -- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 msgr2=0x7f05b0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c4144d80 0x7f05b0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c1d9b640 1 -- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b0004d00 msgr2=0x7f05b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b0004d00 0x7f05b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.788+0000 7f05c1d9b640 1 -- 172.21.15.6:0/478273230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0003520 con 0x7f05b0003ef0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05b00047c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009af0 tx=0x7f05b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62de2460410f87a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac02c6b0 con 0x7f05b0003ef0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac02c810 con 0x7f05b0003ef0 2023-12-19T13:33:06.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c159a640 1 -- 172.21.15.6:0/478273230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac02cba0 con 0x7f05b0003ef0 2023-12-19T13:33:06.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c8927640 1 -- 172.21.15.6:0/478273230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 msgr2=0x7f05b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:06.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c8927640 1 --2- 172.21.15.6:0/478273230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05b00047c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009af0 tx=0x7f05b00057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.789+0000 7f05c2d9d640 1 -- 172.21.15.6:0/478273230 reap_dead start 2023-12-19T13:33:06.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.790+0000 7f05c8927640 1 -- 172.21.15.6:0/478273230 shutdown_connections 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.790+0000 7f05c8927640 1 -- 172.21.15.6:0/478273230 >> 172.21.15.6:0/478273230 conn(0x7f05c406b6a0 msgr2=0x7f05c406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.790+0000 7f05c8927640 1 -- 172.21.15.6:0/478273230 shutdown_connections 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.790+0000 7f05c8927640 1 -- 172.21.15.6:0/478273230 wait complete. 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 Processor -- start 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 -- start start 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05c41e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05c413d4d0 0x7f05c41e0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c414b0d0 0x7f05c4134ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411a9c0 con 0x7f05b0003ef0 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41df600 con 0x7f05c413d4d0 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c8927640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41dfbc0 con 0x7f05c414b0d0 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.791+0000 7f05c259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05c41e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05c41e2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34124/0 (socket says 172.21.15.6:34124) 2023-12-19T13:33:06.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 -- 172.21.15.6:0/1160067643 learned_addr learned my addr 172.21.15.6:0/1160067643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c2d9d640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c414b0d0 0x7f05c4134ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05c413d4d0 0x7f05c41e0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 -- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c414b0d0 msgr2=0x7f05c4134ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c414b0d0 0x7f05c4134ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 -- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05c413d4d0 msgr2=0x7f05c41e0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05c413d4d0 0x7f05c41e0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 -- 172.21.15.6:0/1160067643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c41196f0 con 0x7f05b0003ef0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c259c640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05c41e2b00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0073a0 tx=0x7f05bc007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00f960 con 0x7f05b0003ef0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00fac0 con 0x7f05b0003ef0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00fe30 con 0x7f05b0003ef0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c41df850 con 0x7f05b0003ef0 2023-12-19T13:33:06.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.792+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c414a280 con 0x7f05b0003ef0 2023-12-19T13:33:06.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.793+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c41198e0 con 0x7f05b0003ef0 2023-12-19T13:33:06.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.794+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f05bc01d360 con 0x7f05b0003ef0 2023-12-19T13:33:06.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.794+0000 7f05baffd640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f05a406a460 0x7f05a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:06.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.794+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f05bc088070 con 0x7f05b0003ef0 2023-12-19T13:33:06.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.794+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f05a406a460 0x7f05a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:06.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.795+0000 7f05c1d9b640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f05a406a460 0x7f05a406c920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05ac036000 tx=0x7f05ac030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:06.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.799+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f05bc0538f0 con 0x7f05b0003ef0 2023-12-19T13:33:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:06.975+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f05c4073a40 con 0x7f05b0003ef0 2023-12-19T13:33:07.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.655+0000 7f05baffd640 1 -- 172.21.15.6:0/1160067643 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f05bc01a0d0 con 0x7f05b0003ef0 2023-12-19T13:33:07.657 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-12-19T13:33:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.668+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f05a406a460 msgr2=0x7f05a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.668+0000 7f05c8927640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f05a406a460 0x7f05a406c920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05ac036000 tx=0x7f05ac030000 comp rx=0 tx=0).stop 2023-12-19T13:33:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.669+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 msgr2=0x7f05c41e2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.669+0000 7f05c8927640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05c41e2b00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0073a0 tx=0x7f05bc007860 comp rx=0 tx=0).stop 2023-12-19T13:33:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.670+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 shutdown_connections 2023-12-19T13:33:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.670+0000 7f05c8927640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f05a406a460 0x7f05a406c920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.670+0000 7f05c8927640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05c414b0d0 0x7f05c4134ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.670+0000 7f05c8927640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05c413d4d0 0x7f05c41e0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.670+0000 7f05c8927640 1 --2- 172.21.15.6:0/1160067643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b0003ef0 0x7f05c41e2b00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.670+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 >> 172.21.15.6:0/1160067643 conn(0x7f05c406b6a0 msgr2=0x7f05c406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:07.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.672+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 shutdown_connections 2023-12-19T13:33:07.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.673+0000 7f05c8927640 1 -- 172.21.15.6:0/1160067643 wait complete. 2023-12-19T13:33:07.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:33:07.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.800+0000 7f6abc696640 1 Processor -- start 2023-12-19T13:33:07.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.800+0000 7f6abc696640 1 -- start start 2023-12-19T13:33:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6abc696640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 0x7f6ab40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6abc696640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ab40b77d0 0x7f6ab414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6abc696640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab414ab10 con 0x7f6ab40b8690 2023-12-19T13:33:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6abc696640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab406c2f0 con 0x7f6ab40b77d0 2023-12-19T13:33:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6abc696640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40ba620 con 0x7f6ab4144d80 2023-12-19T13:33:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6aba432640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ab40b8690 0x7f6ab4144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56244/0 (socket says 172.21.15.6:56244) 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6aba432640 1 -- 172.21.15.6:0/1098315869 learned_addr learned my addr 172.21.15.6:0/1098315869 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097906228 0 0) 0x7f6ab414ab10 con 0x7f6ab40b8690 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c003520 con 0x7f6ab40b8690 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6abac33640 1 --2- 172.21.15.6:0/1098315869 >> v2:172.21.15.89:3300/0 conn(0x7f6ab40b77d0 0x7f6ab414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.801+0000 7f6ab9c31640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 0x7f6ab40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716844173 0 0) 0x7f6a9c003520 con 0x7f6ab40b8690 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 msgr2=0x7f6ab40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 0x7f6ab40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 >> v2:172.21.15.89:3300/0 conn(0x7f6ab40b77d0 msgr2=0x7f6ab414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 --2- 172.21.15.6:0/1098315869 >> v2:172.21.15.89:3300/0 conn(0x7f6ab40b77d0 0x7f6ab414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40b9e60 con 0x7f6ab40b8690 2023-12-19T13:33:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f6aac001670 con 0x7f6ab40b8690 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 >> v1:172.21.15.6:6789/0 conn(0x7f6ab40b8690 legacy=0x7f6ab4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6a9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0047c0 0x7f6a9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 0x7f6a9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab406c2f0 con 0x7f6a9c003970 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40ba620 con 0x7f6a9c0047c0 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c00b9d0 con 0x7f6ab4144d80 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6aba432640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6a9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6ab9c31640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0047c0 0x7f6a9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6abac33640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 0x7f6a9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6aba432640 1 -- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 msgr2=0x7f6a9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6aba432640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4144d80 0x7f6a9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6aba432640 1 -- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0047c0 msgr2=0x7f6a9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6aba432640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a9c0047c0 0x7f6a9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.802+0000 7f6aba432640 1 -- 172.21.15.6:0/1098315869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c003520 con 0x7f6a9c003970 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.803+0000 7f6aba432640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6a9c003d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c1c0 tx=0x7f6a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe14ee5a28090c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.803+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac005ad0 con 0x7f6a9c003970 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.803+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac005c30 con 0x7f6a9c003970 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.803+0000 7f6ab9430640 1 -- 172.21.15.6:0/1098315869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac02c850 con 0x7f6a9c003970 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abc696640 1 -- 172.21.15.6:0/1098315869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 msgr2=0x7f6a9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abc696640 1 --2- 172.21.15.6:0/1098315869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6a9c003d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c1c0 tx=0x7f6a9c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abac33640 1 -- 172.21.15.6:0/1098315869 reap_dead start 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abc696640 1 -- 172.21.15.6:0/1098315869 shutdown_connections 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abc696640 1 -- 172.21.15.6:0/1098315869 >> 172.21.15.6:0/1098315869 conn(0x7f6ab406b6a0 msgr2=0x7f6ab406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:07.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abc696640 1 -- 172.21.15.6:0/1098315869 shutdown_connections 2023-12-19T13:33:07.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.804+0000 7f6abc696640 1 -- 172.21.15.6:0/1098315869 wait complete. 2023-12-19T13:33:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.805+0000 7f6abc696640 1 Processor -- start 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.805+0000 7f6abc696640 1 -- start start 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6ab41477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab41e0100 0x7f6ab41e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4148620 0x7f6ab4148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4149550 con 0x7f6a9c003970 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4149dd0 con 0x7f6ab41e0100 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab414a260 con 0x7f6ab4148620 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6ab41477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6ab41477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34146/0 (socket says 172.21.15.6:34146) 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 -- 172.21.15.6:0/3294306444 learned_addr learned my addr 172.21.15.6:0/3294306444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6ab9c31640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab41e0100 0x7f6ab41e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abac33640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4148620 0x7f6ab4148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 -- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4148620 msgr2=0x7f6ab4148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4148620 0x7f6ab4148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 -- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab41e0100 msgr2=0x7f6ab41e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab41e0100 0x7f6ab41e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 -- 172.21.15.6:0/3294306444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab4145160 con 0x7f6a9c003970 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6aba432640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6ab41477b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c1c0 tx=0x7f6aac001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac03c040 con 0x7f6a9c003970 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac02cc60 con 0x7f6a9c003970 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab4149780 con 0x7f6a9c003970 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac007070 con 0x7f6a9c003970 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.806+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab4148080 con 0x7f6a9c003970 2023-12-19T13:33:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.807+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab4073a40 con 0x7f6a9c003970 2023-12-19T13:33:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.808+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6aac032070 con 0x7f6a9c003970 2023-12-19T13:33:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.808+0000 7f6ab2ffd640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6aa006a430 0x7f6aa006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.808+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6aac0a9c70 con 0x7f6a9c003970 2023-12-19T13:33:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.809+0000 7f6ab9c31640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6aa006a430 0x7f6aa006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.809+0000 7f6ab9c31640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6aa006a430 0x7f6aa006c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4140770 tx=0x7f6aa8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:07.813+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6aac0754c0 con 0x7f6a9c003970 2023-12-19T13:33:07.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:07.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:07.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:08.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.028+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6ab4141eb0 con 0x7f6a9c003970 2023-12-19T13:33:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.034+0000 7f6ab2ffd640 1 -- 172.21.15.6:0/3294306444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6aac046020 con 0x7f6a9c003970 2023-12-19T13:33:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T13:33:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.039+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6aa006a430 msgr2=0x7f6aa006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.039+0000 7f6abc696640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6aa006a430 0x7f6aa006c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4140770 tx=0x7f6aa8009190 comp rx=0 tx=0).stop 2023-12-19T13:33:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.039+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 msgr2=0x7f6ab41477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.039+0000 7f6abc696640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6ab41477b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c1c0 tx=0x7f6aac001930 comp rx=0 tx=0).stop 2023-12-19T13:33:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.042+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 shutdown_connections 2023-12-19T13:33:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.042+0000 7f6abc696640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6aa006a430 0x7f6aa006c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.042+0000 7f6abc696640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ab4148620 0x7f6ab4148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.042+0000 7f6abc696640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab41e0100 0x7f6ab41e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.042+0000 7f6abc696640 1 --2- 172.21.15.6:0/3294306444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a9c003970 0x7f6ab41477b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.042+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 >> 172.21.15.6:0/3294306444 conn(0x7f6ab406b6a0 msgr2=0x7f6ab414aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.044+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 shutdown_connections 2023-12-19T13:33:08.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.044+0000 7f6abc696640 1 -- 172.21.15.6:0/3294306444 wait complete. 2023-12-19T13:33:08.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:08.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.168+0000 7f3575423640 1 Processor -- start 2023-12-19T13:33:08.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.168+0000 7f3575423640 1 -- start start 2023-12-19T13:33:08.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f3575423640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357006a6d0 0x7f357014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f3575423640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700bb310 con 0x7f35700ba550 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f3575423640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700bf960 con 0x7f357014b1f0 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f3575423640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35700bb5b0 con 0x7f357006a6d0 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f356f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35700ba550 0x7f35701554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56254/0 (socket says 172.21.15.6:56254) 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f356f7fe640 1 -- 172.21.15.6:0/3171559258 learned_addr learned my addr 172.21.15.6:0/3171559258 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.169+0000 7f356effd640 1 --2- 172.21.15.6:0/3171559258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357006a6d0 0x7f357014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146005366 0 0) 0x7f35700bb310 con 0x7f35700ba550 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c003520 con 0x7f35700ba550 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788316906 0 0) 0x7f35700bf960 con 0x7f357014b1f0 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35700bb310 con 0x7f357014b1f0 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356effd640 1 -- 172.21.15.6:0/3171559258 >> v1:172.21.15.89:6789/0 conn(0x7f357014b1f0 legacy=0x7f35700b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356effd640 1 -- 172.21.15.6:0/3171559258 >> v1:172.21.15.6:6789/0 conn(0x7f35700ba550 legacy=0x7f35701554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.170+0000 7f356effd640 1 -- 172.21.15.6:0/3171559258 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700c0120 con 0x7f357006a6d0 2023-12-19T13:33:08.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f356effd640 1 --2- 172.21.15.6:0/3171559258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357006a6d0 0x7f357014acb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35680097d0 tx=0x7f356802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57a1fa0337fb15c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568031890 con 0x7f357006a6d0 2023-12-19T13:33:08.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35680319f0 con 0x7f357006a6d0 2023-12-19T13:33:08.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f356dffb640 1 -- 172.21.15.6:0/3171559258 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568031d60 con 0x7f357006a6d0 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 -- 172.21.15.6:0/3171559258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357006a6d0 msgr2=0x7f357014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 --2- 172.21.15.6:0/3171559258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357006a6d0 0x7f357014acb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35680097d0 tx=0x7f356802b930 comp rx=0 tx=0).stop 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 -- 172.21.15.6:0/3171559258 shutdown_connections 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 --2- 172.21.15.6:0/3171559258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357006a6d0 0x7f357014acb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 -- 172.21.15.6:0/3171559258 >> 172.21.15.6:0/3171559258 conn(0x7f35700c0350 msgr2=0x7f35700c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 -- 172.21.15.6:0/3171559258 shutdown_connections 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.171+0000 7f3575423640 1 -- 172.21.15.6:0/3171559258 wait complete. 2023-12-19T13:33:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.172+0000 7f3575423640 1 Processor -- start 2023-12-19T13:33:08.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 -- start start 2023-12-19T13:33:08.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357006a6d0 0x7f357014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35700ba550 0x7f35701d5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 0x7f35700b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35701d7e10 con 0x7f357014b1f0 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357014ec10 con 0x7f357006a6d0 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f3575423640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35701d4bb0 con 0x7f35700ba550 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 0x7f35700b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f356f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 0x7f35700b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34162/0 (socket says 172.21.15.6:34162) 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.173+0000 7f356f7fe640 1 -- 172.21.15.6:0/3581252576 learned_addr learned my addr 172.21.15.6:0/3581252576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356e7fc640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35700ba550 0x7f35701d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356effd640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357006a6d0 0x7f357014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356f7fe640 1 -- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35700ba550 msgr2=0x7f35701d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356f7fe640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35700ba550 0x7f35701d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356f7fe640 1 -- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357006a6d0 msgr2=0x7f357014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356f7fe640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357006a6d0 0x7f357014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356f7fe640 1 -- 172.21.15.6:0/3581252576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568009400 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f356f7fe640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 0x7f35700b4540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f356000cb70 tx=0x7f356000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000ace0 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356000ae40 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35701d5c80 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560012620 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.174+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35700b4020 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.175+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35700b4240 con 0x7f357014b1f0 2023-12-19T13:33:08.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.176+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3560007070 con 0x7f357014b1f0 2023-12-19T13:33:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.176+0000 7f35677fe640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f355006a430 0x7f355006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.176+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35600888b0 con 0x7f357014b1f0 2023-12-19T13:33:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.176+0000 7f356effd640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f355006a430 0x7f355006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.177+0000 7f356effd640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f355006a430 0x7f355006c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3568036000 tx=0x7f356803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.181+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35600579c0 con 0x7f357014b1f0 2023-12-19T13:33:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.354+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35700b3e80 con 0x7f357014b1f0 2023-12-19T13:33:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.356+0000 7f35677fe640 1 -- 172.21.15.6:0/3581252576 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15954 (secure 0 0 0) 0x7f35700b3e80 con 0x7f357014b1f0 2023-12-19T13:33:08.358 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:08.358 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:08.028962+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f355006a430 msgr2=0x7f355006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f355006a430 0x7f355006c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3568036000 tx=0x7f356803c040 comp rx=0 tx=0).stop 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 msgr2=0x7f35700b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 0x7f35700b4540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f356000cb70 tx=0x7f356000a430 comp rx=0 tx=0).stop 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 shutdown_connections 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f355006a430 0x7f355006c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f357014b1f0 0x7f35700b4540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35700ba550 0x7f35701d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 --2- 172.21.15.6:0/3581252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357006a6d0 0x7f357014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 >> 172.21.15.6:0/3581252576 conn(0x7f35700c0350 msgr2=0x7f35700a16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 shutdown_connections 2023-12-19T13:33:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.357+0000 7f3575423640 1 -- 172.21.15.6:0/3581252576 wait complete. 2023-12-19T13:33:08.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.474+0000 7fabd1ce2640 1 Processor -- start 2023-12-19T13:33:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.474+0000 7fabd1ce2640 1 -- start start 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabd1ce2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabd1ce2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fabcc0ba000 0x7fabcc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabd1ce2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0bb310 con 0x7fabcc06a6d0 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabd1ce2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc0bf960 con 0x7fabcc0ba000 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabd1ce2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0bb5b0 con 0x7fabcc0ba550 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fabcc0ba000 0x7fabcc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fabcc06a6d0 0x7fabcc14acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56266/0 (socket says 172.21.15.6:56266) 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fabcc0ba000 0x7fabcc1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34170/0 (socket says 172.21.15.6:34170) 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcb7fe640 1 -- 172.21.15.6:0/362845174 learned_addr learned my addr 172.21.15.6:0/362845174 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcaffd640 1 --2- 172.21.15.6:0/362845174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcbfff640 1 -- 172.21.15.6:0/362845174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 msgr2=0x7fabcc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcbfff640 1 --2- 172.21.15.6:0/362845174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcbfff640 1 -- 172.21.15.6:0/362845174 >> v1:172.21.15.6:6789/0 conn(0x7fabcc06a6d0 legacy=0x7fabcc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.475+0000 7fabcbfff640 1 -- 172.21.15.6:0/362845174 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0c0120 con 0x7fabcc0ba000 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.476+0000 7fabcbfff640 1 --2- 172.21.15.6:0/362845174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc1554e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009d90 tx=0x7fabc402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4b47d60787514c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.476+0000 7fabca7fc640 1 -- 172.21.15.6:0/362845174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc402cc50 con 0x7fabcc0ba000 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.476+0000 7fabca7fc640 1 -- 172.21.15.6:0/362845174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc402cdb0 con 0x7fabcc0ba000 2023-12-19T13:33:08.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.476+0000 7fabca7fc640 1 -- 172.21.15.6:0/362845174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4034660 con 0x7fabcc0ba000 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 -- 172.21.15.6:0/362845174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 msgr2=0x7fabcc1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/362845174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc1554e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009d90 tx=0x7fabc402bea0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 -- 172.21.15.6:0/362845174 shutdown_connections 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/362845174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc1554e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/362845174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 -- 172.21.15.6:0/362845174 >> 172.21.15.6:0/362845174 conn(0x7fabcc0c0350 msgr2=0x7fabcc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 -- 172.21.15.6:0/362845174 shutdown_connections 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.477+0000 7fabd1ce2640 1 -- 172.21.15.6:0/362845174 wait complete. 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.478+0000 7fabd1ce2640 1 Processor -- start 2023-12-19T13:33:08.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.478+0000 7fabd1ce2640 1 -- start start 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabcc06a6d0 0x7fabcc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc14e930 con 0x7fabcc0ba000 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc09ace0 con 0x7fabcc06a6d0 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1e2e30 con 0x7fabcc0ba550 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc0b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34182/0 (socket says 172.21.15.6:34182) 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 -- 172.21.15.6:0/206098849 learned_addr learned my addr 172.21.15.6:0/206098849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcbfff640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcb7fe640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabcc06a6d0 0x7fabcc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 -- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 msgr2=0x7fabcc0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 -- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabcc06a6d0 msgr2=0x7fabcc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabcc06a6d0 0x7fabcc14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 -- 172.21.15.6:0/206098849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4009a70 con 0x7fabcc0ba000 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcbfff640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabcaffd640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc0b3e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fabc000e870 tx=0x7fabc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00094f0 con 0x7fabcc0ba000 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000c940 con 0x7fabcc0ba000 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000ccd0 con 0x7fabcc0ba000 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.479+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc1e3080 con 0x7fabcc0ba000 2023-12-19T13:33:08.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.480+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc1e3640 con 0x7fabcc0ba000 2023-12-19T13:33:08.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.481+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc073a40 con 0x7fabcc0ba000 2023-12-19T13:33:08.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.481+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fabc0013470 con 0x7fabcc0ba000 2023-12-19T13:33:08.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.481+0000 7fabb3fff640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fabb806a460 0x7fabb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.482+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabc0088ad0 con 0x7fabcc0ba000 2023-12-19T13:33:08.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.482+0000 7fabcb7fe640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fabb806a460 0x7fabb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.482+0000 7fabcb7fe640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fabb806a460 0x7fabb806c920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fabbc005880 tx=0x7fabbc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.486+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fabc0053fb0 con 0x7fabcc0ba000 2023-12-19T13:33:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.664+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabcc0a62d0 con 0x7fabcc0ba000 2023-12-19T13:33:08.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.665+0000 7fabb3fff640 1 -- 172.21.15.6:0/206098849 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15954 (secure 0 0 0) 0x7fabc00575d0 con 0x7fabcc0ba000 2023-12-19T13:33:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:08.667 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:08.028962+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:08.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fabb806a460 msgr2=0x7fabb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fabb806a460 0x7fabb806c920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fabbc005880 tx=0x7fabbc009040 comp rx=0 tx=0).stop 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 msgr2=0x7fabcc0b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc0b3e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fabc000e870 tx=0x7fabc000ed30 comp rx=0 tx=0).stop 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 shutdown_connections 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fabb806a460 0x7fabb806c920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabcc0ba550 0x7fabcc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabcc0ba000 0x7fabcc0b3e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 --2- 172.21.15.6:0/206098849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabcc06a6d0 0x7fabcc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 >> 172.21.15.6:0/206098849 conn(0x7fabcc0c0350 msgr2=0x7fabcc0a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 shutdown_connections 2023-12-19T13:33:08.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.667+0000 7fabd1ce2640 1 -- 172.21.15.6:0/206098849 wait complete. 2023-12-19T13:33:08.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:33:08.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.787+0000 7f4aadc0b640 1 Processor -- start 2023-12-19T13:33:08.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.787+0000 7f4aadc0b640 1 -- start start 2023-12-19T13:33:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aadc0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4aa80b8690 0x7f4aa80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aadc0b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa8144d80 0x7f4aa814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aadc0b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa814ab10 con 0x7f4aa80b77d0 2023-12-19T13:33:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aadc0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa806c2f0 con 0x7f4aa80b8690 2023-12-19T13:33:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aadc0b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80ba620 con 0x7f4aa8144d80 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4aa80b8690 0x7f4aa80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4aa80b8690 0x7f4aa80b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34196/0 (socket says 172.21.15.6:34196) 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 -- 172.21.15.6:0/3446623612 learned_addr learned my addr 172.21.15.6:0/3446623612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa7fff640 1 --2- 172.21.15.6:0/3446623612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa8144d80 0x7f4aa814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 -- 172.21.15.6:0/3446623612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa8144d80 msgr2=0x7f4aa814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 --2- 172.21.15.6:0/3446623612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa8144d80 0x7f4aa814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 -- 172.21.15.6:0/3446623612 >> v1:172.21.15.89:6789/0 conn(0x7f4aa80b77d0 legacy=0x7f4aa8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.788+0000 7f4aa77fe640 1 -- 172.21.15.6:0/3446623612 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80b9e60 con 0x7f4aa80b8690 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.789+0000 7f4aa77fe640 1 --2- 172.21.15.6:0/3446623612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80b8690 0x7f4aa80b8a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009870 tx=0x7f4a9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b342a58bebfd4389 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.789+0000 7f4aa67fc640 1 -- 172.21.15.6:0/3446623612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98031640 con 0x7f4aa80b8690 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.789+0000 7f4aa67fc640 1 -- 172.21.15.6:0/3446623612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980317a0 con 0x7f4aa80b8690 2023-12-19T13:33:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.789+0000 7f4aa67fc640 1 -- 172.21.15.6:0/3446623612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98031b30 con 0x7f4aa80b8690 2023-12-19T13:33:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 -- 172.21.15.6:0/3446623612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80b8690 msgr2=0x7f4aa80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/3446623612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80b8690 0x7f4aa80b8a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009870 tx=0x7f4a9802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 -- 172.21.15.6:0/3446623612 shutdown_connections 2023-12-19T13:33:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/3446623612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa8144d80 0x7f4aa814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/3446623612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80b8690 0x7f4aa80b8a70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 -- 172.21.15.6:0/3446623612 >> 172.21.15.6:0/3446623612 conn(0x7f4aa806b6a0 msgr2=0x7f4aa806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 -- 172.21.15.6:0/3446623612 shutdown_connections 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.790+0000 7f4aadc0b640 1 -- 172.21.15.6:0/3446623612 wait complete. 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.791+0000 7f4aadc0b640 1 Processor -- start 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.791+0000 7f4aadc0b640 1 -- start start 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80b77d0 0x7f4aa8148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80b8690 0x7f4aa8147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 0x7f4aa81462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8149690 con 0x7f4aa8144d80 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8149e90 con 0x7f4aa80b77d0 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa814a170 con 0x7f4aa80b8690 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 0x7f4aa81462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 0x7f4aa81462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34202/0 (socket says 172.21.15.6:34202) 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 -- 172.21.15.6:0/1065558537 learned_addr learned my addr 172.21.15.6:0/1065558537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa77fe640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80b77d0 0x7f4aa8148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 -- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80b8690 msgr2=0x7f4aa8147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa6ffd640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80b8690 0x7f4aa8147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80b8690 0x7f4aa8147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 -- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80b77d0 msgr2=0x7f4aa8148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80b77d0 0x7f4aa8148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 -- 172.21.15.6:0/1065558537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980094d0 con 0x7f4aa8144d80 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aa7fff640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 0x7f4aa81462d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0007de0 tx=0x7f4aa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0014620 con 0x7f4aa8144d80 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa000ee90 con 0x7f4aa8144d80 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa814a450 con 0x7f4aa8144d80 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00149e0 con 0x7f4aa8144d80 2023-12-19T13:33:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.792+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa8149ab0 con 0x7f4aa8144d80 2023-12-19T13:33:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.793+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa8149cd0 con 0x7f4aa8144d80 2023-12-19T13:33:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.794+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4aa0014b40 con 0x7f4aa8144d80 2023-12-19T13:33:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.794+0000 7f4a8ffff640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4a9406a430 0x7f4a9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.794+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4aa00893c0 con 0x7f4aa8144d80 2023-12-19T13:33:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.794+0000 7f4aa77fe640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4a9406a430 0x7f4a9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.795+0000 7f4aa77fe640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4a9406a430 0x7f4a9406c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a98036000 tx=0x7f4a9803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:08.799+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4aa0054920 con 0x7f4aa8144d80 2023-12-19T13:33:09.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.010+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4aa814a640 con 0x7f4aa8144d80 2023-12-19T13:33:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.670+0000 7f4a8ffff640 1 -- 172.21.15.6:0/1065558537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4aa0057f40 con 0x7f4aa8144d80 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.672+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4a9406a430 msgr2=0x7f4a9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.672+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4a9406a430 0x7f4a9406c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a98036000 tx=0x7f4a9803c040 comp rx=0 tx=0).stop 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.672+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 msgr2=0x7f4aa81462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.672+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 0x7f4aa81462d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0007de0 tx=0x7f4aa000e4b0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.672+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 shutdown_connections 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.672+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4a9406a430 0x7f4a9406c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.673+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8144d80 0x7f4aa81462d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.673+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa80b8690 0x7f4aa8147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.673+0000 7f4aadc0b640 1 --2- 172.21.15.6:0/1065558537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa80b77d0 0x7f4aa8148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.673+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 >> 172.21.15.6:0/1065558537 conn(0x7f4aa806b6a0 msgr2=0x7f4aa80ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.673+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 shutdown_connections 2023-12-19T13:33:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.673+0000 7f4aadc0b640 1 -- 172.21.15.6:0/1065558537 wait complete. 2023-12-19T13:33:09.688 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:33:09.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:33:09.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.800+0000 7f0962ba2640 1 Processor -- start 2023-12-19T13:33:09.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f0962ba2640 1 -- start start 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f0962ba2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f0962ba2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f095c14b230 0x7f095c14e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f0962ba2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095c0b8a20 con 0x7f095c14ec90 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f0962ba2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095c0b8d00 con 0x7f095c14b230 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f0962ba2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c14aa30 con 0x7f095c06af80 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f096139f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f095c14b230 0x7f095c14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f096139f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f095c14b230 0x7f095c14e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34204/0 (socket says 172.21.15.6:34204) 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.801+0000 7f096139f640 1 -- 172.21.15.6:0/2619982381 learned_addr learned my addr 172.21.15.6:0/2619982381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.802+0000 7f0961ba0640 1 --2- 172.21.15.6:0/2619982381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.802+0000 7f096139f640 1 -- 172.21.15.6:0/2619982381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 msgr2=0x7f095c06f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:09.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.802+0000 7f096139f640 1 --2- 172.21.15.6:0/2619982381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c06f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.802+0000 7f096139f640 1 -- 172.21.15.6:0/2619982381 >> v1:172.21.15.89:6789/0 conn(0x7f095c14ec90 legacy=0x7f095c0b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.802+0000 7f096139f640 1 -- 172.21.15.6:0/2619982381 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c0b69d0 con 0x7f095c14b230 2023-12-19T13:33:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.802+0000 7f096139f640 1 --2- 172.21.15.6:0/2619982381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c14e750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f094c009850 tx=0x7f094c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772a57a51d18872c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0960b9e640 1 -- 172.21.15.6:0/2619982381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c004230 con 0x7f095c14b230 2023-12-19T13:33:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0960b9e640 1 -- 172.21.15.6:0/2619982381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c004390 con 0x7f095c14b230 2023-12-19T13:33:09.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0960b9e640 1 -- 172.21.15.6:0/2619982381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c02f830 con 0x7f095c14b230 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 -- 172.21.15.6:0/2619982381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 msgr2=0x7f095c14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 --2- 172.21.15.6:0/2619982381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c14e750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f094c009850 tx=0x7f094c02ba10 comp rx=0 tx=0).stop 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 -- 172.21.15.6:0/2619982381 shutdown_connections 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 --2- 172.21.15.6:0/2619982381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c14e750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 --2- 172.21.15.6:0/2619982381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c06f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 -- 172.21.15.6:0/2619982381 >> 172.21.15.6:0/2619982381 conn(0x7f095c0b9060 msgr2=0x7f095c0b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 -- 172.21.15.6:0/2619982381 shutdown_connections 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.803+0000 7f0962ba2640 1 -- 172.21.15.6:0/2619982381 wait complete. 2023-12-19T13:33:09.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.804+0000 7f0962ba2640 1 Processor -- start 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.804+0000 7f0962ba2640 1 -- start start 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0962ba2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0962ba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0962ba2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f095c142830 0x7f095c142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0962ba2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095c0b4af0 con 0x7f095c14b230 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0962ba2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095c14da30 con 0x7f095c142830 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0962ba2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c1e4180 con 0x7f095c06af80 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34210/0 (socket says 172.21.15.6:34210) 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 -- 172.21.15.6:0/275721702 learned_addr learned my addr 172.21.15.6:0/275721702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f09623a1640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f095c142830 0x7f095c142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f0961ba0640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 -- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 msgr2=0x7f095c14d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c14d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 -- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f095c142830 msgr2=0x7f095c142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f095c142830 0x7f095c142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.805+0000 7f096139f640 1 -- 172.21.15.6:0/275721702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c009460 con 0x7f095c14b230 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.806+0000 7f096139f640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c144cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f094c02ba50 tx=0x7f094c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.806+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c03d070 con 0x7f095c14b230 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.806+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c004500 con 0x7f095c14b230 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.806+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095c143200 con 0x7f095c14b230 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.806+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c02fe10 con 0x7f095c14b230 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.806+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095c1e3da0 con 0x7f095c14b230 2023-12-19T13:33:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.807+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095c1e42c0 con 0x7f095c14b230 2023-12-19T13:33:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.807+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f094c003610 con 0x7f095c14b230 2023-12-19T13:33:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.808+0000 7f09527fc640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f094006a430 0x7f094006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.808+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f094c0aa8b0 con 0x7f095c14b230 2023-12-19T13:33:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.808+0000 7f0961ba0640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f094006a430 0x7f094006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.808+0000 7f0961ba0640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f094006a430 0x7f094006c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0958006fd0 tx=0x7f0958008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:09.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:09.812+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f095c1e42c0 con 0x7f095c14b230 2023-12-19T13:33:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.023+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f095c1e42c0 con 0x7f095c14b230 2023-12-19T13:33:10.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.672+0000 7f09527fc640 1 -- 172.21.15.6:0/275721702 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f095c1e42c0 con 0x7f095c14b230 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f094006a430 msgr2=0x7f094006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f094006a430 0x7f094006c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0958006fd0 tx=0x7f0958008040 comp rx=0 tx=0).stop 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 msgr2=0x7f095c144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c144cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f094c02ba50 tx=0x7f094c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 shutdown_connections 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f094006a430 0x7f094006c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f095c142830 0x7f095c142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095c14b230 0x7f095c144cb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 --2- 172.21.15.6:0/275721702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f095c06af80 0x7f095c14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 >> 172.21.15.6:0/275721702 conn(0x7f095c0b9060 msgr2=0x7f095c0b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:10.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 shutdown_connections 2023-12-19T13:33:10.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.675+0000 7f0962ba2640 1 -- 172.21.15.6:0/275721702 wait complete. 2023-12-19T13:33:10.690 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:33:10.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:10.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 Processor -- start 2023-12-19T13:33:10.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 -- start start 2023-12-19T13:33:10.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f073806a6d0 0x7f073814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 0x7f07381554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07380bb310 con 0x7f073814b1f0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07380bf960 con 0x7f073806a6d0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.800+0000 7f073e316640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07380bb5b0 con 0x7f07380ba550 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f07377fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f073814b1f0 0x7f07380b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56268/0 (socket says 172.21.15.6:56268) 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f07377fe640 1 -- 172.21.15.6:0/1591174741 learned_addr learned my addr 172.21.15.6:0/1591174741 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f073c8b3640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 0x7f07381554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0737fff640 1 --2- 172.21.15.6:0/1591174741 >> v2:172.21.15.89:3300/0 conn(0x7f073806a6d0 0x7f073814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735275475 0 0) 0x7f07380bb310 con 0x7f073814b1f0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0720003520 con 0x7f073814b1f0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 381329272 0 0) 0x7f0720003520 con 0x7f073814b1f0 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 msgr2=0x7f07381554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 0x7f07381554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 >> v2:172.21.15.89:3300/0 conn(0x7f073806a6d0 msgr2=0x7f073814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 --2- 172.21.15.6:0/1591174741 >> v2:172.21.15.89:3300/0 conn(0x7f073806a6d0 0x7f073814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380c0120 con 0x7f073814b1f0 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0737fff640 1 --2- 172.21.15.6:0/1591174741 >> v2:172.21.15.89:3300/0 conn(0x7f073806a6d0 0x7f073814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f072c001670 con 0x7f073814b1f0 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 >> v1:172.21.15.6:6789/0 conn(0x7f073814b1f0 legacy=0x7f07380b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 0x7f0720003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f07200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0720004d00 0x7f0720005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380bf960 con 0x7f0720003ef0 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380bb5b0 con 0x7f0720004d00 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072000b980 con 0x7f07380ba550 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.801+0000 7f07377fe640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f07200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f0737fff640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 0x7f0720003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f073c8b3640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0720004d00 0x7f0720005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f07377fe640 1 -- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 msgr2=0x7f0720003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f07377fe640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07380ba550 0x7f0720003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f07377fe640 1 -- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0720004d00 msgr2=0x7f0720005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f07377fe640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0720004d00 0x7f0720005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.802+0000 7f07377fe640 1 -- 172.21.15.6:0/1591174741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720003520 con 0x7f0720003ef0 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f07377fe640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f07200047c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f073806b3a0 tx=0x7f07200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ba7ed6e4d218f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c005ad0 con 0x7f0720003ef0 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c005c30 con 0x7f0720003ef0 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f0736ffd640 1 -- 172.21.15.6:0/1591174741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c02cac0 con 0x7f0720003ef0 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073e316640 1 -- 172.21.15.6:0/1591174741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 msgr2=0x7f07200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073e316640 1 --2- 172.21.15.6:0/1591174741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f07200047c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f073806b3a0 tx=0x7f07200057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073c8b3640 1 -- 172.21.15.6:0/1591174741 reap_dead start 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073e316640 1 -- 172.21.15.6:0/1591174741 shutdown_connections 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073e316640 1 -- 172.21.15.6:0/1591174741 >> 172.21.15.6:0/1591174741 conn(0x7f07380c0350 msgr2=0x7f07380c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073e316640 1 -- 172.21.15.6:0/1591174741 shutdown_connections 2023-12-19T13:33:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.803+0000 7f073e316640 1 -- 172.21.15.6:0/1591174741 wait complete. 2023-12-19T13:33:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.804+0000 7f073e316640 1 Processor -- start 2023-12-19T13:33:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.804+0000 7f073e316640 1 -- start start 2023-12-19T13:33:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073e316640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f073814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073e316640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f073814a640 0x7f073809e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073e316640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073809ed50 0x7f0738149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073e316640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073814e930 con 0x7f0720003ef0 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073e316640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073809d3e0 con 0x7f073814a640 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073e316640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073809f1d0 con 0x7f073809ed50 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f073814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f073814e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34230/0 (socket says 172.21.15.6:34230) 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 -- 172.21.15.6:0/868210807 learned_addr learned my addr 172.21.15.6:0/868210807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073c8b3640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073809ed50 0x7f0738149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f07377fe640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f073814a640 0x7f073809e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 -- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073809ed50 msgr2=0x7f0738149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073809ed50 0x7f0738149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 -- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f073814a640 msgr2=0x7f073809e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f073814a640 0x7f073809e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f0737fff640 1 -- 172.21.15.6:0/868210807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073809d100 con 0x7f0720003ef0 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.805+0000 7f073c8b3640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073809ed50 0x7f0738149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.806+0000 7f0737fff640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f073814e3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0728011d30 tx=0x7f072800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.806+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072800fd20 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.806+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800fe80 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.806+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07380b69a0 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.806+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728004240 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.806+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073814ecf0 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.807+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07380b6800 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.807+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0728003610 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.808+0000 7f0734ff9640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f072406a430 0x7f072406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.808+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07280896c0 con 0x7f0720003ef0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.808+0000 7f07377fe640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f072406a430 0x7f072406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:10.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.808+0000 7f07377fe640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f072406a430 0x7f072406c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f072c034000 tx=0x7f072c007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:10.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:10.812+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07380b6800 con 0x7f0720003ef0 2023-12-19T13:33:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.027+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07380b6800 con 0x7f0720003ef0 2023-12-19T13:33:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.027+0000 7f0734ff9640 1 -- 172.21.15.6:0/868210807 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f07380b6800 con 0x7f0720003ef0 2023-12-19T13:33:11.030 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:11.030 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f072406a430 msgr2=0x7f072406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f072406a430 0x7f072406c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f072c034000 tx=0x7f072c007000 comp rx=0 tx=0).stop 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 msgr2=0x7f073814e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f073814e3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0728011d30 tx=0x7f072800f610 comp rx=0 tx=0).stop 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 shutdown_connections 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f072406a430 0x7f072406c8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073809ed50 0x7f0738149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f073814a640 0x7f073809e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.029+0000 7f073e316640 1 --2- 172.21.15.6:0/868210807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0720003ef0 0x7f073814e3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.030+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 >> 172.21.15.6:0/868210807 conn(0x7f07380c0350 msgr2=0x7f07380be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:11.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.030+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 shutdown_connections 2023-12-19T13:33:11.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.030+0000 7f073e316640 1 -- 172.21.15.6:0/868210807 wait complete. 2023-12-19T13:33:11.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.145+0000 7fe1b4ace640 1 Processor -- start 2023-12-19T13:33:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.145+0000 7fe1b4ace640 1 -- start start 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1b4ace640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1b00b7ea0 0x7fe1b00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1b4ace640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1b00b8280 0x7fe1b00b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1b4ace640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00b4230 con 0x7fe1b00b7130 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1b4ace640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00711c0 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1b4ace640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00714a0 con 0x7fe1b00b8280 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1ae59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1b00b7ea0 0x7fe1b00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1add9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1b00b7130 0x7fe1b0142910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56276/0 (socket says 172.21.15.6:56276) 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1ae59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1b00b7ea0 0x7fe1b00b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34244/0 (socket says 172.21.15.6:34244) 2023-12-19T13:33:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.146+0000 7fe1add9b640 1 -- 172.21.15.6:0/963329710 learned_addr learned my addr 172.21.15.6:0/963329710 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1aed9d640 1 --2- 172.21.15.6:0/963329710 >> v2:172.21.15.89:3300/0 conn(0x7fe1b00b8280 0x7fe1b00b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1ae59c640 1 -- 172.21.15.6:0/963329710 >> v2:172.21.15.89:3300/0 conn(0x7fe1b00b8280 msgr2=0x7fe1b00b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1ae59c640 1 --2- 172.21.15.6:0/963329710 >> v2:172.21.15.89:3300/0 conn(0x7fe1b00b8280 0x7fe1b00b89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1ae59c640 1 -- 172.21.15.6:0/963329710 >> v1:172.21.15.6:6789/0 conn(0x7fe1b00b7130 legacy=0x7fe1b0142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1ae59c640 1 -- 172.21.15.6:0/963329710 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0071780 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1ad59a640 1 -- 172.21.15.6:0/963329710 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091249218 0 0) 0x7fe1b00b4230 con 0x7fe1b00b7130 2023-12-19T13:33:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1aed9d640 1 --2- 172.21.15.6:0/963329710 >> v2:172.21.15.89:3300/0 conn(0x7fe1b00b8280 0x7fe1b00b89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.147+0000 7fe1ae59c640 1 --2- 172.21.15.6:0/963329710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b00b6bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1b006f700 tx=0x7fe1a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30a1a24cc4ff712 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1ad59a640 1 -- 172.21.15.6:0/963329710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0030610 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1ad59a640 1 -- 172.21.15.6:0/963329710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0030770 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1ad59a640 1 -- 172.21.15.6:0/963329710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0030b00 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 -- 172.21.15.6:0/963329710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 msgr2=0x7fe1b00b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/963329710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b00b6bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1b006f700 tx=0x7fe1a002b960 comp rx=0 tx=0).stop 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 -- 172.21.15.6:0/963329710 shutdown_connections 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/963329710 >> v2:172.21.15.89:3300/0 conn(0x7fe1b00b8280 0x7fe1b00b89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/963329710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b00b6bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 -- 172.21.15.6:0/963329710 >> 172.21.15.6:0/963329710 conn(0x7fe1b00bd060 msgr2=0x7fe1b00bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 -- 172.21.15.6:0/963329710 shutdown_connections 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.148+0000 7fe1b4ace640 1 -- 172.21.15.6:0/963329710 wait complete. 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.149+0000 7fe1b4ace640 1 Processor -- start 2023-12-19T13:33:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.149+0000 7fe1b4ace640 1 -- start start 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1b4ace640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1b00b7130 0x7fe1b0148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1b4ace640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b0148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1b4ace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1b00b8280 0x7fe1b0148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1b4ace640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0144b30 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1b4ace640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0146c50 con 0x7fe1b00b8280 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1b4ace640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0147c90 con 0x7fe1b00b7130 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1add9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b0148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1add9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b0148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34260/0 (socket says 172.21.15.6:34260) 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1add9b640 1 -- 172.21.15.6:0/2847828343 learned_addr learned my addr 172.21.15.6:0/2847828343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:11.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1ae59c640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1b00b7130 0x7fe1b0148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.150+0000 7fe1aed9d640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1b00b8280 0x7fe1b0148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1add9b640 1 -- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1b00b7130 msgr2=0x7fe1b0148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1add9b640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1b00b7130 0x7fe1b0148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1add9b640 1 -- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1b00b8280 msgr2=0x7fe1b0148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1add9b640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1b00b8280 0x7fe1b0148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1add9b640 1 -- 172.21.15.6:0/2847828343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0009400 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1add9b640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b0148120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c4e0 tx=0x7fe1a400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40074e0 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4007660 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4004a20 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b013dfd0 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.151+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0147920 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.152+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0073a40 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.152+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1a4004b80 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.153+0000 7fe19effd640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe19006a430 0x7fe19006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.153+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1a4087ae0 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.153+0000 7fe1ae59c640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe19006a430 0x7fe19006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.154+0000 7fe1ae59c640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe19006a430 0x7fe19006c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0036000 tx=0x7fe1a0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.157+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1a4053240 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.333+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1b00bdc10 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.334+0000 7fe19effd640 1 -- 172.21.15.6:0/2847828343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7fe1a4018070 con 0x7fe1b00b7ea0 2023-12-19T13:33:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:11.337 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.336+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe19006a430 msgr2=0x7fe19006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.336+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe19006a430 0x7fe19006c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0036000 tx=0x7fe1a0008030 comp rx=0 tx=0).stop 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.336+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 msgr2=0x7fe1b0148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.336+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b0148120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c4e0 tx=0x7fe1a400c9a0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 shutdown_connections 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe19006a430 0x7fe19006c8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1b00b8280 0x7fe1b0148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b00b7ea0 0x7fe1b0148120 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 --2- 172.21.15.6:0/2847828343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1b00b7130 0x7fe1b0148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 >> 172.21.15.6:0/2847828343 conn(0x7fe1b00bd060 msgr2=0x7fe1b00bbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 shutdown_connections 2023-12-19T13:33:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.337+0000 7fe1b4ace640 1 -- 172.21.15.6:0/2847828343 wait complete. 2023-12-19T13:33:11.349 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:33:11.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:33:11.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.452+0000 7f1487f38640 1 Processor -- start 2023-12-19T13:33:11.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.452+0000 7f1487f38640 1 -- start start 2023-12-19T13:33:11.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1487f38640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f14800ba550 0x7f14800b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1487f38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14800ba000 0x7f14801554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1487f38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14800bb310 con 0x7f148006a6d0 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1487f38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800bf960 con 0x7f14800ba000 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1487f38640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800bb5b0 con 0x7f14800ba550 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1485cd4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f148006a6d0 0x7f148014acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56278/0 (socket says 172.21.15.6:56278) 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1485cd4640 1 -- 172.21.15.6:0/3817399462 learned_addr learned my addr 172.21.15.6:0/3817399462 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14864d5640 1 --2- 172.21.15.6:0/3817399462 >> v2:172.21.15.6:3300/0 conn(0x7f14800ba000 0x7f14801554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14854d3640 1 --2- 172.21.15.6:0/3817399462 >> v2:172.21.15.89:3300/0 conn(0x7f14800ba550 0x7f14800b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14864d5640 1 -- 172.21.15.6:0/3817399462 >> v2:172.21.15.89:3300/0 conn(0x7f14800ba550 msgr2=0x7f14800b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14864d5640 1 --2- 172.21.15.6:0/3817399462 >> v2:172.21.15.89:3300/0 conn(0x7f14800ba550 0x7f14800b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14864d5640 1 -- 172.21.15.6:0/3817399462 >> v1:172.21.15.6:6789/0 conn(0x7f148006a6d0 legacy=0x7f148014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f1484cd2640 1 -- 172.21.15.6:0/3817399462 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263162194 0 0) 0x7f14800bb310 con 0x7f148006a6d0 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14864d5640 1 -- 172.21.15.6:0/3817399462 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800c0120 con 0x7f14800ba000 2023-12-19T13:33:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.453+0000 7f14854d3640 1 --2- 172.21.15.6:0/3817399462 >> v2:172.21.15.89:3300/0 conn(0x7f14800ba550 0x7f14800b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.454+0000 7f14864d5640 1 --2- 172.21.15.6:0/3817399462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14800ba000 0x7f14801554e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14800bde10 tx=0x7f147002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7773272475e664 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.454+0000 7f1484cd2640 1 -- 172.21.15.6:0/3817399462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470031830 con 0x7f14800ba000 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.454+0000 7f1484cd2640 1 -- 172.21.15.6:0/3817399462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470031990 con 0x7f14800ba000 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.454+0000 7f1484cd2640 1 -- 172.21.15.6:0/3817399462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470031d20 con 0x7f14800ba000 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 -- 172.21.15.6:0/3817399462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14800ba000 msgr2=0x7f14801554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 --2- 172.21.15.6:0/3817399462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14800ba000 0x7f14801554e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14800bde10 tx=0x7f147002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 -- 172.21.15.6:0/3817399462 shutdown_connections 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 --2- 172.21.15.6:0/3817399462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14800ba000 0x7f14801554e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 --2- 172.21.15.6:0/3817399462 >> v2:172.21.15.89:3300/0 conn(0x7f14800ba550 0x7f14800b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 -- 172.21.15.6:0/3817399462 >> 172.21.15.6:0/3817399462 conn(0x7f14800c0350 msgr2=0x7f14800c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 -- 172.21.15.6:0/3817399462 shutdown_connections 2023-12-19T13:33:11.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.455+0000 7f1487f38640 1 -- 172.21.15.6:0/3817399462 wait complete. 2023-12-19T13:33:11.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.456+0000 7f1487f38640 1 Processor -- start 2023-12-19T13:33:11.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.456+0000 7f1487f38640 1 -- start start 2023-12-19T13:33:11.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 0x7f148014e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14800ba000 0x7f14800b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14800ba550 0x7f1480146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800a4b50 con 0x7f148006a6d0 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148014e930 con 0x7f14800ba550 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800b5c10 con 0x7f14800ba000 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 0x7f148014e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 0x7f148014e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34274/0 (socket says 172.21.15.6:34274) 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 -- 172.21.15.6:0/2453326653 learned_addr learned my addr 172.21.15.6:0/2453326653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f14854d3640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14800ba000 0x7f14800b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f14864d5640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14800ba550 0x7f1480146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 -- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14800ba000 msgr2=0x7f14800b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14800ba000 0x7f14800b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 -- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14800ba550 msgr2=0x7f1480146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14800ba550 0x7f1480146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 -- 172.21.15.6:0/2453326653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009400 con 0x7f148006a6d0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1485cd4640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 0x7f148014e3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f147800c890 tx=0x7f147800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800a640 con 0x7f148006a6d0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147800a7c0 con 0x7f148006a6d0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148014eba0 con 0x7f148006a6d0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800ab70 con 0x7f148006a6d0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.457+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14800a5010 con 0x7f148006a6d0 2023-12-19T13:33:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.458+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14800a0db0 con 0x7f148006a6d0 2023-12-19T13:33:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.459+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f147800acd0 con 0x7f148006a6d0 2023-12-19T13:33:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.459+0000 7f147e7fc640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f146c06a430 0x7f146c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.459+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14780881f0 con 0x7f148006a6d0 2023-12-19T13:33:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.460+0000 7f14854d3640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f146c06a430 0x7f146c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.460+0000 7f14854d3640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f146c06a430 0x7f146c06c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14800bae50 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.464+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14780537d0 con 0x7f148006a6d0 2023-12-19T13:33:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.635+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14800bfc00 con 0x7f146c06a430 2023-12-19T13:33:11.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.642+0000 7f147e7fc640 1 -- 172.21.15.6:0/2453326653 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249806 (secure 0 0 0) 0x7f147400c040 con 0x7f146c06a430 2023-12-19T13:33:11.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T13:33:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f146c06a430 msgr2=0x7f146c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f146c06a430 0x7f146c06c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14800bae50 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-12-19T13:33:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 msgr2=0x7f148014e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 0x7f148014e3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f147800c890 tx=0x7f147800cd50 comp rx=0 tx=0).stop 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 shutdown_connections 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f146c06a430 0x7f146c06c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14800ba550 0x7f1480146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14800ba000 0x7f14800b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 --2- 172.21.15.6:0/2453326653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148006a6d0 0x7f148014e3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 >> 172.21.15.6:0/2453326653 conn(0x7f14800c0350 msgr2=0x7f14800a06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 shutdown_connections 2023-12-19T13:33:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.645+0000 7f1487f38640 1 -- 172.21.15.6:0/2453326653 wait complete. 2023-12-19T13:33:11.657 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T13:33:09.951196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":217984,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756736,"statfs":{"total":773094113280,"available":772870897664,"internally_reserved":0,"allocated":2424832,"data_stored":1544546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-19T13:32:59.063904+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T13:32:59.063904+0000","last_peered":"2023-12-19T13:32:59.063904+0000","last_clean":"2023-12-19T13:32:59.063904+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T13:32:59.063904+0000","last_undegraded":"2023-12-19T13:32:59.063904+0000","last_fullsized":"2023-12-19T13:32:59.063904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:07.647893+0000","last_change":"2023-12-19T13:33:07.647893+0000","last_active":"2023-12-19T13:33:07.647893+0000","last_peered":"2023-12-19T13:33:07.647893+0000","last_clean":"2023-12-19T13:33:07.647893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:07.647893+0000","last_undegraded":"2023-12-19T13:33:07.647893+0000","last_fullsized":"2023-12-19T13:33:07.647893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:06.642477+0000","last_change":"2023-12-19T13:33:06.642477+0000","last_active":"2023-12-19T13:33:06.642477+0000","last_peered":"2023-12-19T13:33:06.642477+0000","last_clean":"2023-12-19T13:33:06.642477+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:06.642477+0000","last_undegraded":"2023-12-19T13:33:06.642477+0000","last_fullsized":"2023-12-19T13:33:06.642477+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27100,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":151552,"data_stored":44712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":635080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T13:33:11.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:33:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.801+0000 7f6adba95640 1 Processor -- start 2023-12-19T13:33:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.801+0000 7f6adba95640 1 -- start start 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.801+0000 7f6adba95640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ad41544e0 0x7f6ad41568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.801+0000 7f6adba95640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad40bb310 con 0x7f6ad40ba550 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.801+0000 7f6adba95640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad40bf960 con 0x7f6ad406a6d0 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.801+0000 7f6adba95640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad40bb5b0 con 0x7f6ad41544e0 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ada032640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ad41544e0 0x7f6ad41568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ad9030640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ad40ba550 0x7f6ad40b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56286/0 (socket says 172.21.15.6:56286) 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ad9030640 1 -- 172.21.15.6:0/4252193654 learned_addr learned my addr 172.21.15.6:0/4252193654 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ada032640 1 -- 172.21.15.6:0/4252193654 >> v1:172.21.15.89:6789/0 conn(0x7f6ad406a6d0 legacy=0x7f6ad414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ada032640 1 -- 172.21.15.6:0/4252193654 >> v1:172.21.15.6:6789/0 conn(0x7f6ad40ba550 legacy=0x7f6ad40b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ada032640 1 -- 172.21.15.6:0/4252193654 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad40c0120 con 0x7f6ad41544e0 2023-12-19T13:33:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.802+0000 7f6ad882f640 1 -- 172.21.15.6:0/4252193654 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813668693 0 0) 0x7f6ad40bb310 con 0x7f6ad40ba550 2023-12-19T13:33:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6ada032640 1 --2- 172.21.15.6:0/4252193654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad41544e0 0x7f6ad41568d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009d90 tx=0x7f6acc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c1a01786e4a95d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6ad882f640 1 -- 172.21.15.6:0/4252193654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc02cc60 con 0x7f6ad41544e0 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6ad882f640 1 -- 172.21.15.6:0/4252193654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc02cdc0 con 0x7f6ad41544e0 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6ad882f640 1 -- 172.21.15.6:0/4252193654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc034660 con 0x7f6ad41544e0 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 -- 172.21.15.6:0/4252193654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad41544e0 msgr2=0x7f6ad41568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 --2- 172.21.15.6:0/4252193654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad41544e0 0x7f6ad41568d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009d90 tx=0x7f6acc02beb0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 -- 172.21.15.6:0/4252193654 shutdown_connections 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 --2- 172.21.15.6:0/4252193654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad41544e0 0x7f6ad41568d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 -- 172.21.15.6:0/4252193654 >> 172.21.15.6:0/4252193654 conn(0x7f6ad40c0350 msgr2=0x7f6ad40c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 -- 172.21.15.6:0/4252193654 shutdown_connections 2023-12-19T13:33:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.803+0000 7f6adba95640 1 -- 172.21.15.6:0/4252193654 wait complete. 2023-12-19T13:33:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.804+0000 7f6adba95640 1 Processor -- start 2023-12-19T13:33:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.804+0000 7f6adba95640 1 -- start start 2023-12-19T13:33:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6adba95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 0x7f6ad41e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6adba95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad40ba550 0x7f6ad40a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6adba95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad41544e0 0x7f6ad41e06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6adba95640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40a5af0 con 0x7f6ad406a6d0 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6adba95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad41e0220 con 0x7f6ad40ba550 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6adba95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40a0710 con 0x7f6ad41544e0 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 0x7f6ad41e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 0x7f6ad41e38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34294/0 (socket says 172.21.15.6:34294) 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 -- 172.21.15.6:0/4276990254 learned_addr learned my addr 172.21.15.6:0/4276990254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 -- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad41544e0 msgr2=0x7f6ad41e06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ada032640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad41544e0 0x7f6ad41e06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9030640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad40ba550 0x7f6ad40a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad41544e0 0x7f6ad41e06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 -- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad40ba550 msgr2=0x7f6ad40a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad40ba550 0x7f6ad40a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.805+0000 7f6ad9831640 1 -- 172.21.15.6:0/4276990254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc009a70 con 0x7f6ad406a6d0 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.806+0000 7f6ad9831640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 0x7f6ad41e38a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c430 tx=0x7f6ad000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.806+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0011790 con 0x7f6ad406a6d0 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.806+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00118f0 con 0x7f6ad406a6d0 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.806+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0011ce0 con 0x7f6ad406a6d0 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.806+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad41dfef0 con 0x7f6ad406a6d0 2023-12-19T13:33:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.806+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad41e41c0 con 0x7f6ad406a6d0 2023-12-19T13:33:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.807+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad4073a40 con 0x7f6ad406a6d0 2023-12-19T13:33:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.807+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ad001c460 con 0x7f6ad406a6d0 2023-12-19T13:33:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.808+0000 7f6aca7fc640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6ab806a430 0x7f6ab806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.808+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ad0088850 con 0x7f6ad406a6d0 2023-12-19T13:33:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.808+0000 7f6ad9030640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6ab806a430 0x7f6ab806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.808+0000 7f6ad9030640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6ab806a430 0x7f6ab806c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4007fd0 tx=0x7f6ac4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.812+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ad0053e40 con 0x7f6ad406a6d0 2023-12-19T13:33:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.985+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ad414b3c0 con 0x7f6ab806a430 2023-12-19T13:33:11.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.993+0000 7f6aca7fc640 1 -- 172.21.15.6:0/4276990254 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264684 (secure 0 0 0) 0x7f6ac4001c70 con 0x7f6ab806a430 2023-12-19T13:33:11.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:11.999 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.995+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6ab806a430 msgr2=0x7f6ab806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.995+0000 7f6adba95640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6ab806a430 0x7f6ab806c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4007fd0 tx=0x7f6ac4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 msgr2=0x7f6ad41e38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 0x7f6ad41e38a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c430 tx=0x7f6ad000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 shutdown_connections 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6ab806a430 0x7f6ab806c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad41544e0 0x7f6ad41e06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad40ba550 0x7f6ad40a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 --2- 172.21.15.6:0/4276990254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ad406a6d0 0x7f6ad41e38a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 >> 172.21.15.6:0/4276990254 conn(0x7f6ad40c0350 msgr2=0x7f6ad40a0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:12.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 shutdown_connections 2023-12-19T13:33:12.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:11.996+0000 7f6adba95640 1 -- 172.21.15.6:0/4276990254 wait complete. 2023-12-19T13:33:12.008 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-19T13:33:11.951727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.302885"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466927+0000","last_change":"2023-12-19T13:33:08.041371+0000","last_active":"2023-12-19T13:33:09.466927+0000","last_peered":"2023-12-19T13:33:09.466927+0000","last_clean":"2023-12-19T13:33:09.466927+0000","last_became_active":"2023-12-19T13:33:08.040678+0000","last_became_peered":"2023-12-19T13:33:08.040678+0000","last_unstale":"2023-12-19T13:33:09.466927+0000","last_undegraded":"2023-12-19T13:33:09.466927+0000","last_fullsized":"2023-12-19T13:33:09.466927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037904+0000","last_change":"2023-12-19T13:33:08.043430+0000","last_active":"2023-12-19T13:33:09.037904+0000","last_peered":"2023-12-19T13:33:09.037904+0000","last_clean":"2023-12-19T13:33:09.037904+0000","last_became_active":"2023-12-19T13:33:08.043199+0000","last_became_peered":"2023-12-19T13:33:08.043199+0000","last_unstale":"2023-12-19T13:33:09.037904+0000","last_undegraded":"2023-12-19T13:33:09.037904+0000","last_fullsized":"2023-12-19T13:33:09.037904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467146+0000","last_change":"2023-12-19T13:33:08.049139+0000","last_active":"2023-12-19T13:33:09.467146+0000","last_peered":"2023-12-19T13:33:09.467146+0000","last_clean":"2023-12-19T13:33:09.467146+0000","last_became_active":"2023-12-19T13:33:08.048824+0000","last_became_peered":"2023-12-19T13:33:08.048824+0000","last_unstale":"2023-12-19T13:33:09.467146+0000","last_undegraded":"2023-12-19T13:33:09.467146+0000","last_fullsized":"2023-12-19T13:33:09.467146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:27.092015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466903+0000","last_change":"2023-12-19T13:33:08.058348+0000","last_active":"2023-12-19T13:33:09.466903+0000","last_peered":"2023-12-19T13:33:09.466903+0000","last_clean":"2023-12-19T13:33:09.466903+0000","last_became_active":"2023-12-19T13:33:08.058068+0000","last_became_peered":"2023-12-19T13:33:08.058068+0000","last_unstale":"2023-12-19T13:33:09.466903+0000","last_undegraded":"2023-12-19T13:33:09.466903+0000","last_fullsized":"2023-12-19T13:33:09.466903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:09.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466535+0000","last_change":"2023-12-19T13:33:08.050316+0000","last_active":"2023-12-19T13:33:09.466535+0000","last_peered":"2023-12-19T13:33:09.466535+0000","last_clean":"2023-12-19T13:33:09.466535+0000","last_became_active":"2023-12-19T13:33:08.050049+0000","last_became_peered":"2023-12-19T13:33:08.050049+0000","last_unstale":"2023-12-19T13:33:09.466535+0000","last_undegraded":"2023-12-19T13:33:09.466535+0000","last_fullsized":"2023-12-19T13:33:09.466535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466400+0000","last_change":"2023-12-19T13:33:08.052140+0000","last_active":"2023-12-19T13:33:09.466400+0000","last_peered":"2023-12-19T13:33:09.466400+0000","last_clean":"2023-12-19T13:33:09.466400+0000","last_became_active":"2023-12-19T13:33:08.051880+0000","last_became_peered":"2023-12-19T13:33:08.051880+0000","last_unstale":"2023-12-19T13:33:09.466400+0000","last_undegraded":"2023-12-19T13:33:09.466400+0000","last_fullsized":"2023-12-19T13:33:09.466400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:42:07.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466195+0000","last_change":"2023-12-19T13:33:08.052900+0000","last_active":"2023-12-19T13:33:09.466195+0000","last_peered":"2023-12-19T13:33:09.466195+0000","last_clean":"2023-12-19T13:33:09.466195+0000","last_became_active":"2023-12-19T13:33:08.052646+0000","last_became_peered":"2023-12-19T13:33:08.052646+0000","last_unstale":"2023-12-19T13:33:09.466195+0000","last_undegraded":"2023-12-19T13:33:09.466195+0000","last_fullsized":"2023-12-19T13:33:09.466195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:50:47.691016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466321+0000","last_change":"2023-12-19T13:33:08.055307+0000","last_active":"2023-12-19T13:33:09.466321+0000","last_peered":"2023-12-19T13:33:09.466321+0000","last_clean":"2023-12-19T13:33:09.466321+0000","last_became_active":"2023-12-19T13:33:08.055092+0000","last_became_peered":"2023-12-19T13:33:08.055092+0000","last_unstale":"2023-12-19T13:33:09.466321+0000","last_undegraded":"2023-12-19T13:33:09.466321+0000","last_fullsized":"2023-12-19T13:33:09.466321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467034+0000","last_change":"2023-12-19T13:33:08.052567+0000","last_active":"2023-12-19T13:33:09.467034+0000","last_peered":"2023-12-19T13:33:09.467034+0000","last_clean":"2023-12-19T13:33:09.467034+0000","last_became_active":"2023-12-19T13:33:08.052171+0000","last_became_peered":"2023-12-19T13:33:08.052171+0000","last_unstale":"2023-12-19T13:33:09.467034+0000","last_undegraded":"2023-12-19T13:33:09.467034+0000","last_fullsized":"2023-12-19T13:33:09.467034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:42:07.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039444+0000","last_change":"2023-12-19T13:33:08.056053+0000","last_active":"2023-12-19T13:33:09.039444+0000","last_peered":"2023-12-19T13:33:09.039444+0000","last_clean":"2023-12-19T13:33:09.039444+0000","last_became_active":"2023-12-19T13:33:08.055787+0000","last_became_peered":"2023-12-19T13:33:08.055787+0000","last_unstale":"2023-12-19T13:33:09.039444+0000","last_undegraded":"2023-12-19T13:33:09.039444+0000","last_fullsized":"2023-12-19T13:33:09.039444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039047+0000","last_change":"2023-12-19T13:33:08.056109+0000","last_active":"2023-12-19T13:33:09.039047+0000","last_peered":"2023-12-19T13:33:09.039047+0000","last_clean":"2023-12-19T13:33:09.039047+0000","last_became_active":"2023-12-19T13:33:08.055845+0000","last_became_peered":"2023-12-19T13:33:08.055845+0000","last_unstale":"2023-12-19T13:33:09.039047+0000","last_undegraded":"2023-12-19T13:33:09.039047+0000","last_fullsized":"2023-12-19T13:33:09.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039467+0000","last_change":"2023-12-19T13:33:08.042537+0000","last_active":"2023-12-19T13:33:09.039467+0000","last_peered":"2023-12-19T13:33:09.039467+0000","last_clean":"2023-12-19T13:33:09.039467+0000","last_became_active":"2023-12-19T13:33:08.042257+0000","last_became_peered":"2023-12-19T13:33:08.042257+0000","last_unstale":"2023-12-19T13:33:09.039467+0000","last_undegraded":"2023-12-19T13:33:09.039467+0000","last_fullsized":"2023-12-19T13:33:09.039467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:33.372229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466544+0000","last_change":"2023-12-19T13:33:08.043899+0000","last_active":"2023-12-19T13:33:09.466544+0000","last_peered":"2023-12-19T13:33:09.466544+0000","last_clean":"2023-12-19T13:33:09.466544+0000","last_became_active":"2023-12-19T13:33:08.043653+0000","last_became_peered":"2023-12-19T13:33:08.043653+0000","last_unstale":"2023-12-19T13:33:09.466544+0000","last_undegraded":"2023-12-19T13:33:09.466544+0000","last_fullsized":"2023-12-19T13:33:09.466544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466915+0000","last_change":"2023-12-19T13:33:08.044597+0000","last_active":"2023-12-19T13:33:09.466915+0000","last_peered":"2023-12-19T13:33:09.466915+0000","last_clean":"2023-12-19T13:33:09.466915+0000","last_became_active":"2023-12-19T13:33:08.044327+0000","last_became_peered":"2023-12-19T13:33:08.044327+0000","last_unstale":"2023-12-19T13:33:09.466915+0000","last_undegraded":"2023-12-19T13:33:09.466915+0000","last_fullsized":"2023-12-19T13:33:09.466915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037792+0000","last_change":"2023-12-19T13:33:08.045469+0000","last_active":"2023-12-19T13:33:09.037792+0000","last_peered":"2023-12-19T13:33:09.037792+0000","last_clean":"2023-12-19T13:33:09.037792+0000","last_became_active":"2023-12-19T13:33:08.045205+0000","last_became_peered":"2023-12-19T13:33:08.045205+0000","last_unstale":"2023-12-19T13:33:09.037792+0000","last_undegraded":"2023-12-19T13:33:09.037792+0000","last_fullsized":"2023-12-19T13:33:09.037792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466140+0000","last_change":"2023-12-19T13:33:08.053422+0000","last_active":"2023-12-19T13:33:09.466140+0000","last_peered":"2023-12-19T13:33:09.466140+0000","last_clean":"2023-12-19T13:33:09.466140+0000","last_became_active":"2023-12-19T13:33:08.053139+0000","last_became_peered":"2023-12-19T13:33:08.053139+0000","last_unstale":"2023-12-19T13:33:09.466140+0000","last_undegraded":"2023-12-19T13:33:09.466140+0000","last_fullsized":"2023-12-19T13:33:09.466140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:46.064148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467005+0000","last_change":"2023-12-19T13:33:08.057816+0000","last_active":"2023-12-19T13:33:09.467005+0000","last_peered":"2023-12-19T13:33:09.467005+0000","last_clean":"2023-12-19T13:33:09.467005+0000","last_became_active":"2023-12-19T13:33:08.057561+0000","last_became_peered":"2023-12-19T13:33:08.057561+0000","last_unstale":"2023-12-19T13:33:09.467005+0000","last_undegraded":"2023-12-19T13:33:09.467005+0000","last_fullsized":"2023-12-19T13:33:09.467005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466452+0000","last_change":"2023-12-19T13:33:08.041795+0000","last_active":"2023-12-19T13:33:09.466452+0000","last_peered":"2023-12-19T13:33:09.466452+0000","last_clean":"2023-12-19T13:33:09.466452+0000","last_became_active":"2023-12-19T13:33:08.041545+0000","last_became_peered":"2023-12-19T13:33:08.041545+0000","last_unstale":"2023-12-19T13:33:09.466452+0000","last_undegraded":"2023-12-19T13:33:09.466452+0000","last_fullsized":"2023-12-19T13:33:09.466452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:33.372229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467153+0000","last_change":"2023-12-19T13:33:08.049871+0000","last_active":"2023-12-19T13:33:09.467153+0000","last_peered":"2023-12-19T13:33:09.467153+0000","last_clean":"2023-12-19T13:33:09.467153+0000","last_became_active":"2023-12-19T13:33:08.049592+0000","last_became_peered":"2023-12-19T13:33:08.049592+0000","last_unstale":"2023-12-19T13:33:09.467153+0000","last_undegraded":"2023-12-19T13:33:09.467153+0000","last_fullsized":"2023-12-19T13:33:09.467153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039359+0000","last_change":"2023-12-19T13:33:08.046648+0000","last_active":"2023-12-19T13:33:09.039359+0000","last_peered":"2023-12-19T13:33:09.039359+0000","last_clean":"2023-12-19T13:33:09.039359+0000","last_became_active":"2023-12-19T13:33:08.046365+0000","last_became_peered":"2023-12-19T13:33:08.046365+0000","last_unstale":"2023-12-19T13:33:09.039359+0000","last_undegraded":"2023-12-19T13:33:09.039359+0000","last_fullsized":"2023-12-19T13:33:09.039359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467090+0000","last_change":"2023-12-19T13:33:08.050719+0000","last_active":"2023-12-19T13:33:09.467090+0000","last_peered":"2023-12-19T13:33:09.467090+0000","last_clean":"2023-12-19T13:33:09.467090+0000","last_became_active":"2023-12-19T13:33:08.050479+0000","last_became_peered":"2023-12-19T13:33:08.050479+0000","last_unstale":"2023-12-19T13:33:09.467090+0000","last_undegraded":"2023-12-19T13:33:09.467090+0000","last_fullsized":"2023-12-19T13:33:09.467090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466507+0000","last_change":"2023-12-19T13:33:08.056711+0000","last_active":"2023-12-19T13:33:09.466507+0000","last_peered":"2023-12-19T13:33:09.466507+0000","last_clean":"2023-12-19T13:33:09.466507+0000","last_became_active":"2023-12-19T13:33:08.055926+0000","last_became_peered":"2023-12-19T13:33:08.055926+0000","last_unstale":"2023-12-19T13:33:09.466507+0000","last_undegraded":"2023-12-19T13:33:09.466507+0000","last_fullsized":"2023-12-19T13:33:09.466507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466502+0000","last_change":"2023-12-19T13:33:08.045737+0000","last_active":"2023-12-19T13:33:09.466502+0000","last_peered":"2023-12-19T13:33:09.466502+0000","last_clean":"2023-12-19T13:33:09.466502+0000","last_became_active":"2023-12-19T13:33:08.045342+0000","last_became_peered":"2023-12-19T13:33:08.045342+0000","last_unstale":"2023-12-19T13:33:09.466502+0000","last_undegraded":"2023-12-19T13:33:09.466502+0000","last_fullsized":"2023-12-19T13:33:09.466502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466274+0000","last_change":"2023-12-19T13:33:08.057789+0000","last_active":"2023-12-19T13:33:09.466274+0000","last_peered":"2023-12-19T13:33:09.466274+0000","last_clean":"2023-12-19T13:33:09.466274+0000","last_became_active":"2023-12-19T13:33:08.057533+0000","last_became_peered":"2023-12-19T13:33:08.057533+0000","last_unstale":"2023-12-19T13:33:09.466274+0000","last_undegraded":"2023-12-19T13:33:09.466274+0000","last_fullsized":"2023-12-19T13:33:09.466274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:08:01.224172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466784+0000","last_change":"2023-12-19T13:33:08.047959+0000","last_active":"2023-12-19T13:33:09.466784+0000","last_peered":"2023-12-19T13:33:09.466784+0000","last_clean":"2023-12-19T13:33:09.466784+0000","last_became_active":"2023-12-19T13:33:08.047597+0000","last_became_peered":"2023-12-19T13:33:08.047597+0000","last_unstale":"2023-12-19T13:33:09.466784+0000","last_undegraded":"2023-12-19T13:33:09.466784+0000","last_fullsized":"2023-12-19T13:33:09.466784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039459+0000","last_change":"2023-12-19T13:33:08.044259+0000","last_active":"2023-12-19T13:33:09.039459+0000","last_peered":"2023-12-19T13:33:09.039459+0000","last_clean":"2023-12-19T13:33:09.039459+0000","last_became_active":"2023-12-19T13:33:08.043702+0000","last_became_peered":"2023-12-19T13:33:08.043702+0000","last_unstale":"2023-12-19T13:33:09.039459+0000","last_undegraded":"2023-12-19T13:33:09.039459+0000","last_fullsized":"2023-12-19T13:33:09.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037888+0000","last_change":"2023-12-19T13:33:08.040797+0000","last_active":"2023-12-19T13:33:09.037888+0000","last_peered":"2023-12-19T13:33:09.037888+0000","last_clean":"2023-12-19T13:33:09.037888+0000","last_became_active":"2023-12-19T13:33:08.040509+0000","last_became_peered":"2023-12-19T13:33:08.040509+0000","last_unstale":"2023-12-19T13:33:09.037888+0000","last_undegraded":"2023-12-19T13:33:09.037888+0000","last_fullsized":"2023-12-19T13:33:09.037888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466911+0000","last_change":"2023-12-19T13:33:08.047963+0000","last_active":"2023-12-19T13:33:09.466911+0000","last_peered":"2023-12-19T13:33:09.466911+0000","last_clean":"2023-12-19T13:33:09.466911+0000","last_became_active":"2023-12-19T13:33:08.047279+0000","last_became_peered":"2023-12-19T13:33:08.047279+0000","last_unstale":"2023-12-19T13:33:09.466911+0000","last_undegraded":"2023-12-19T13:33:09.466911+0000","last_fullsized":"2023-12-19T13:33:09.466911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:27.092015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467135+0000","last_change":"2023-12-19T13:33:08.048816+0000","last_active":"2023-12-19T13:33:09.467135+0000","last_peered":"2023-12-19T13:33:09.467135+0000","last_clean":"2023-12-19T13:33:09.467135+0000","last_became_active":"2023-12-19T13:33:08.044942+0000","last_became_peered":"2023-12-19T13:33:08.044942+0000","last_unstale":"2023-12-19T13:33:09.467135+0000","last_undegraded":"2023-12-19T13:33:09.467135+0000","last_fullsized":"2023-12-19T13:33:09.467135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467033+0000","last_change":"2023-12-19T13:33:08.057063+0000","last_active":"2023-12-19T13:33:09.467033+0000","last_peered":"2023-12-19T13:33:09.467033+0000","last_clean":"2023-12-19T13:33:09.467033+0000","last_became_active":"2023-12-19T13:33:08.056806+0000","last_became_peered":"2023-12-19T13:33:08.056806+0000","last_unstale":"2023-12-19T13:33:09.467033+0000","last_undegraded":"2023-12-19T13:33:09.467033+0000","last_fullsized":"2023-12-19T13:33:09.467033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:05.765112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466207+0000","last_change":"2023-12-19T13:33:08.056055+0000","last_active":"2023-12-19T13:33:09.466207+0000","last_peered":"2023-12-19T13:33:09.466207+0000","last_clean":"2023-12-19T13:33:09.466207+0000","last_became_active":"2023-12-19T13:33:08.055797+0000","last_became_peered":"2023-12-19T13:33:08.055797+0000","last_unstale":"2023-12-19T13:33:09.466207+0000","last_undegraded":"2023-12-19T13:33:09.466207+0000","last_fullsized":"2023-12-19T13:33:09.466207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:52.562074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038687+0000","last_change":"2023-12-19T13:33:08.048418+0000","last_active":"2023-12-19T13:33:09.038687+0000","last_peered":"2023-12-19T13:33:09.038687+0000","last_clean":"2023-12-19T13:33:09.038687+0000","last_became_active":"2023-12-19T13:33:08.048151+0000","last_became_peered":"2023-12-19T13:33:08.048151+0000","last_unstale":"2023-12-19T13:33:09.038687+0000","last_undegraded":"2023-12-19T13:33:09.038687+0000","last_fullsized":"2023-12-19T13:33:09.038687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039686+0000","last_change":"2023-12-19T13:33:08.038978+0000","last_active":"2023-12-19T13:33:09.039686+0000","last_peered":"2023-12-19T13:33:09.039686+0000","last_clean":"2023-12-19T13:33:09.039686+0000","last_became_active":"2023-12-19T13:33:08.038729+0000","last_became_peered":"2023-12-19T13:33:08.038729+0000","last_unstale":"2023-12-19T13:33:09.039686+0000","last_undegraded":"2023-12-19T13:33:09.039686+0000","last_fullsized":"2023-12-19T13:33:09.039686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:14.038723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466660+0000","last_change":"2023-12-19T13:33:07.671519+0000","last_active":"2023-12-19T13:33:09.466660+0000","last_peered":"2023-12-19T13:33:09.466660+0000","last_clean":"2023-12-19T13:33:09.466660+0000","last_became_active":"2023-12-19T13:33:07.671235+0000","last_became_peered":"2023-12-19T13:33:07.671235+0000","last_unstale":"2023-12-19T13:33:09.466660+0000","last_undegraded":"2023-12-19T13:33:09.466660+0000","last_fullsized":"2023-12-19T13:33:09.466660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467228+0000","last_change":"2023-12-19T13:33:08.049297+0000","last_active":"2023-12-19T13:33:09.467228+0000","last_peered":"2023-12-19T13:33:09.467228+0000","last_clean":"2023-12-19T13:33:09.467228+0000","last_became_active":"2023-12-19T13:33:08.049080+0000","last_became_peered":"2023-12-19T13:33:08.049080+0000","last_unstale":"2023-12-19T13:33:09.467228+0000","last_undegraded":"2023-12-19T13:33:09.467228+0000","last_fullsized":"2023-12-19T13:33:09.467228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:00:30.701307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038996+0000","last_change":"2023-12-19T13:33:07.663905+0000","last_active":"2023-12-19T13:33:09.038996+0000","last_peered":"2023-12-19T13:33:09.038996+0000","last_clean":"2023-12-19T13:33:09.038996+0000","last_became_active":"2023-12-19T13:33:07.663563+0000","last_became_peered":"2023-12-19T13:33:07.663563+0000","last_unstale":"2023-12-19T13:33:09.038996+0000","last_undegraded":"2023-12-19T13:33:09.038996+0000","last_fullsized":"2023-12-19T13:33:09.038996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466613+0000","last_change":"2023-12-19T13:33:07.662002+0000","last_active":"2023-12-19T13:33:09.466613+0000","last_peered":"2023-12-19T13:33:09.466613+0000","last_clean":"2023-12-19T13:33:09.466613+0000","last_became_active":"2023-12-19T13:33:07.661666+0000","last_became_peered":"2023-12-19T13:33:07.661666+0000","last_unstale":"2023-12-19T13:33:09.466613+0000","last_undegraded":"2023-12-19T13:33:09.466613+0000","last_fullsized":"2023-12-19T13:33:09.466613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466362+0000","last_change":"2023-12-19T13:33:08.045306+0000","last_active":"2023-12-19T13:33:09.466362+0000","last_peered":"2023-12-19T13:33:09.466362+0000","last_clean":"2023-12-19T13:33:09.466362+0000","last_became_active":"2023-12-19T13:33:08.045039+0000","last_became_peered":"2023-12-19T13:33:08.045039+0000","last_unstale":"2023-12-19T13:33:09.466362+0000","last_undegraded":"2023-12-19T13:33:09.466362+0000","last_fullsized":"2023-12-19T13:33:09.466362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466477+0000","last_change":"2023-12-19T13:33:07.673766+0000","last_active":"2023-12-19T13:33:09.466477+0000","last_peered":"2023-12-19T13:33:09.466477+0000","last_clean":"2023-12-19T13:33:09.466477+0000","last_became_active":"2023-12-19T13:33:07.673463+0000","last_became_peered":"2023-12-19T13:33:07.673463+0000","last_unstale":"2023-12-19T13:33:09.466477+0000","last_undegraded":"2023-12-19T13:33:09.466477+0000","last_fullsized":"2023-12-19T13:33:09.466477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037777+0000","last_change":"2023-12-19T13:33:08.043832+0000","last_active":"2023-12-19T13:33:09.037777+0000","last_peered":"2023-12-19T13:33:09.037777+0000","last_clean":"2023-12-19T13:33:09.037777+0000","last_became_active":"2023-12-19T13:33:08.042167+0000","last_became_peered":"2023-12-19T13:33:08.042167+0000","last_unstale":"2023-12-19T13:33:09.037777+0000","last_undegraded":"2023-12-19T13:33:09.037777+0000","last_fullsized":"2023-12-19T13:33:09.037777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039233+0000","last_change":"2023-12-19T13:33:07.671819+0000","last_active":"2023-12-19T13:33:09.039233+0000","last_peered":"2023-12-19T13:33:09.039233+0000","last_clean":"2023-12-19T13:33:09.039233+0000","last_became_active":"2023-12-19T13:33:07.671550+0000","last_became_peered":"2023-12-19T13:33:07.671550+0000","last_unstale":"2023-12-19T13:33:09.039233+0000","last_undegraded":"2023-12-19T13:33:09.039233+0000","last_fullsized":"2023-12-19T13:33:09.039233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466753+0000","last_change":"2023-12-19T13:33:08.056202+0000","last_active":"2023-12-19T13:33:09.466753+0000","last_peered":"2023-12-19T13:33:09.466753+0000","last_clean":"2023-12-19T13:33:09.466753+0000","last_became_active":"2023-12-19T13:33:08.055954+0000","last_became_peered":"2023-12-19T13:33:08.055954+0000","last_unstale":"2023-12-19T13:33:09.466753+0000","last_undegraded":"2023-12-19T13:33:09.466753+0000","last_fullsized":"2023-12-19T13:33:09.466753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466862+0000","last_change":"2023-12-19T13:33:07.672051+0000","last_active":"2023-12-19T13:33:09.466862+0000","last_peered":"2023-12-19T13:33:09.466862+0000","last_clean":"2023-12-19T13:33:09.466862+0000","last_became_active":"2023-12-19T13:33:07.671460+0000","last_became_peered":"2023-12-19T13:33:07.671460+0000","last_unstale":"2023-12-19T13:33:09.466862+0000","last_undegraded":"2023-12-19T13:33:09.466862+0000","last_fullsized":"2023-12-19T13:33:09.466862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467333+0000","last_change":"2023-12-19T13:33:08.049996+0000","last_active":"2023-12-19T13:33:09.467333+0000","last_peered":"2023-12-19T13:33:09.467333+0000","last_clean":"2023-12-19T13:33:09.467333+0000","last_became_active":"2023-12-19T13:33:08.049731+0000","last_became_peered":"2023-12-19T13:33:08.049731+0000","last_unstale":"2023-12-19T13:33:09.467333+0000","last_undegraded":"2023-12-19T13:33:09.467333+0000","last_fullsized":"2023-12-19T13:33:09.467333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037979+0000","last_change":"2023-12-19T13:33:07.669934+0000","last_active":"2023-12-19T13:33:09.037979+0000","last_peered":"2023-12-19T13:33:09.037979+0000","last_clean":"2023-12-19T13:33:09.037979+0000","last_became_active":"2023-12-19T13:33:07.669396+0000","last_became_peered":"2023-12-19T13:33:07.669396+0000","last_unstale":"2023-12-19T13:33:09.037979+0000","last_undegraded":"2023-12-19T13:33:09.037979+0000","last_fullsized":"2023-12-19T13:33:09.037979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039568+0000","last_change":"2023-12-19T13:33:08.053672+0000","last_active":"2023-12-19T13:33:09.039568+0000","last_peered":"2023-12-19T13:33:09.039568+0000","last_clean":"2023-12-19T13:33:09.039568+0000","last_became_active":"2023-12-19T13:33:08.052055+0000","last_became_peered":"2023-12-19T13:33:08.052055+0000","last_unstale":"2023-12-19T13:33:09.039568+0000","last_undegraded":"2023-12-19T13:33:09.039568+0000","last_fullsized":"2023-12-19T13:33:09.039568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:17:53.430044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039446+0000","last_change":"2023-12-19T13:33:07.666435+0000","last_active":"2023-12-19T13:33:09.039446+0000","last_peered":"2023-12-19T13:33:09.039446+0000","last_clean":"2023-12-19T13:33:09.039446+0000","last_became_active":"2023-12-19T13:33:07.666031+0000","last_became_peered":"2023-12-19T13:33:07.666031+0000","last_unstale":"2023-12-19T13:33:09.039446+0000","last_undegraded":"2023-12-19T13:33:09.039446+0000","last_fullsized":"2023-12-19T13:33:09.039446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466989+0000","last_change":"2023-12-19T13:33:08.046354+0000","last_active":"2023-12-19T13:33:09.466989+0000","last_peered":"2023-12-19T13:33:09.466989+0000","last_clean":"2023-12-19T13:33:09.466989+0000","last_became_active":"2023-12-19T13:33:08.046083+0000","last_became_peered":"2023-12-19T13:33:08.046083+0000","last_unstale":"2023-12-19T13:33:09.466989+0000","last_undegraded":"2023-12-19T13:33:09.466989+0000","last_fullsized":"2023-12-19T13:33:09.466989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467261+0000","last_change":"2023-12-19T13:33:07.666609+0000","last_active":"2023-12-19T13:33:09.467261+0000","last_peered":"2023-12-19T13:33:09.467261+0000","last_clean":"2023-12-19T13:33:09.467261+0000","last_became_active":"2023-12-19T13:33:07.665764+0000","last_became_peered":"2023-12-19T13:33:07.665764+0000","last_unstale":"2023-12-19T13:33:09.467261+0000","last_undegraded":"2023-12-19T13:33:09.467261+0000","last_fullsized":"2023-12-19T13:33:09.467261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466915+0000","last_change":"2023-12-19T13:33:08.051291+0000","last_active":"2023-12-19T13:33:09.466915+0000","last_peered":"2023-12-19T13:33:09.466915+0000","last_clean":"2023-12-19T13:33:09.466915+0000","last_became_active":"2023-12-19T13:33:08.051016+0000","last_became_peered":"2023-12-19T13:33:08.051016+0000","last_unstale":"2023-12-19T13:33:09.466915+0000","last_undegraded":"2023-12-19T13:33:09.466915+0000","last_fullsized":"2023-12-19T13:33:09.466915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466597+0000","last_change":"2023-12-19T13:33:07.675720+0000","last_active":"2023-12-19T13:33:09.466597+0000","last_peered":"2023-12-19T13:33:09.466597+0000","last_clean":"2023-12-19T13:33:09.466597+0000","last_became_active":"2023-12-19T13:33:07.675434+0000","last_became_peered":"2023-12-19T13:33:07.675434+0000","last_unstale":"2023-12-19T13:33:09.466597+0000","last_undegraded":"2023-12-19T13:33:09.466597+0000","last_fullsized":"2023-12-19T13:33:09.466597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466680+0000","last_change":"2023-12-19T13:33:08.051519+0000","last_active":"2023-12-19T13:33:09.466680+0000","last_peered":"2023-12-19T13:33:09.466680+0000","last_clean":"2023-12-19T13:33:09.466680+0000","last_became_active":"2023-12-19T13:33:08.050189+0000","last_became_peered":"2023-12-19T13:33:08.050189+0000","last_unstale":"2023-12-19T13:33:09.466680+0000","last_undegraded":"2023-12-19T13:33:09.466680+0000","last_fullsized":"2023-12-19T13:33:09.466680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038751+0000","last_change":"2023-12-19T13:33:07.663565+0000","last_active":"2023-12-19T13:33:09.038751+0000","last_peered":"2023-12-19T13:33:09.038751+0000","last_clean":"2023-12-19T13:33:09.038751+0000","last_became_active":"2023-12-19T13:33:07.663174+0000","last_became_peered":"2023-12-19T13:33:07.663174+0000","last_unstale":"2023-12-19T13:33:09.038751+0000","last_undegraded":"2023-12-19T13:33:09.038751+0000","last_fullsized":"2023-12-19T13:33:09.038751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038815+0000","last_change":"2023-12-19T13:33:08.048060+0000","last_active":"2023-12-19T13:33:09.038815+0000","last_peered":"2023-12-19T13:33:09.038815+0000","last_clean":"2023-12-19T13:33:09.038815+0000","last_became_active":"2023-12-19T13:33:08.047791+0000","last_became_peered":"2023-12-19T13:33:08.047791+0000","last_unstale":"2023-12-19T13:33:09.038815+0000","last_undegraded":"2023-12-19T13:33:09.038815+0000","last_fullsized":"2023-12-19T13:33:09.038815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.465958+0000","last_change":"2023-12-19T13:33:07.665027+0000","last_active":"2023-12-19T13:33:09.465958+0000","last_peered":"2023-12-19T13:33:09.465958+0000","last_clean":"2023-12-19T13:33:09.465958+0000","last_became_active":"2023-12-19T13:33:07.664706+0000","last_became_peered":"2023-12-19T13:33:07.664706+0000","last_unstale":"2023-12-19T13:33:09.465958+0000","last_undegraded":"2023-12-19T13:33:09.465958+0000","last_fullsized":"2023-12-19T13:33:09.465958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466823+0000","last_change":"2023-12-19T13:33:08.052125+0000","last_active":"2023-12-19T13:33:09.466823+0000","last_peered":"2023-12-19T13:33:09.466823+0000","last_clean":"2023-12-19T13:33:09.466823+0000","last_became_active":"2023-12-19T13:33:08.051831+0000","last_became_peered":"2023-12-19T13:33:08.051831+0000","last_unstale":"2023-12-19T13:33:09.466823+0000","last_undegraded":"2023-12-19T13:33:09.466823+0000","last_fullsized":"2023-12-19T13:33:09.466823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:05.765112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039227+0000","last_change":"2023-12-19T13:33:07.668053+0000","last_active":"2023-12-19T13:33:09.039227+0000","last_peered":"2023-12-19T13:33:09.039227+0000","last_clean":"2023-12-19T13:33:09.039227+0000","last_became_active":"2023-12-19T13:33:07.667791+0000","last_became_peered":"2023-12-19T13:33:07.667791+0000","last_unstale":"2023-12-19T13:33:09.039227+0000","last_undegraded":"2023-12-19T13:33:09.039227+0000","last_fullsized":"2023-12-19T13:33:09.039227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:47.342437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466698+0000","last_change":"2023-12-19T13:33:08.049950+0000","last_active":"2023-12-19T13:33:09.466698+0000","last_peered":"2023-12-19T13:33:09.466698+0000","last_clean":"2023-12-19T13:33:09.466698+0000","last_became_active":"2023-12-19T13:33:08.049688+0000","last_became_peered":"2023-12-19T13:33:08.049688+0000","last_unstale":"2023-12-19T13:33:09.466698+0000","last_undegraded":"2023-12-19T13:33:09.466698+0000","last_fullsized":"2023-12-19T13:33:09.466698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:05.364189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466401+0000","last_change":"2023-12-19T13:33:07.671312+0000","last_active":"2023-12-19T13:33:09.466401+0000","last_peered":"2023-12-19T13:33:09.466401+0000","last_clean":"2023-12-19T13:33:09.466401+0000","last_became_active":"2023-12-19T13:33:07.670997+0000","last_became_peered":"2023-12-19T13:33:07.670997+0000","last_unstale":"2023-12-19T13:33:09.466401+0000","last_undegraded":"2023-12-19T13:33:09.466401+0000","last_fullsized":"2023-12-19T13:33:09.466401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467114+0000","last_change":"2023-12-19T13:33:08.052491+0000","last_active":"2023-12-19T13:33:09.467114+0000","last_peered":"2023-12-19T13:33:09.467114+0000","last_clean":"2023-12-19T13:33:09.467114+0000","last_became_active":"2023-12-19T13:33:08.050405+0000","last_became_peered":"2023-12-19T13:33:08.050405+0000","last_unstale":"2023-12-19T13:33:09.467114+0000","last_undegraded":"2023-12-19T13:33:09.467114+0000","last_fullsized":"2023-12-19T13:33:09.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:09.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038055+0000","last_change":"2023-12-19T13:33:07.673634+0000","last_active":"2023-12-19T13:33:09.038055+0000","last_peered":"2023-12-19T13:33:09.038055+0000","last_clean":"2023-12-19T13:33:09.038055+0000","last_became_active":"2023-12-19T13:33:07.673391+0000","last_became_peered":"2023-12-19T13:33:07.673391+0000","last_unstale":"2023-12-19T13:33:09.038055+0000","last_undegraded":"2023-12-19T13:33:09.038055+0000","last_fullsized":"2023-12-19T13:33:09.038055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466616+0000","last_change":"2023-12-19T13:33:08.057771+0000","last_active":"2023-12-19T13:33:09.466616+0000","last_peered":"2023-12-19T13:33:09.466616+0000","last_clean":"2023-12-19T13:33:09.466616+0000","last_became_active":"2023-12-19T13:33:08.057153+0000","last_became_peered":"2023-12-19T13:33:08.057153+0000","last_unstale":"2023-12-19T13:33:09.466616+0000","last_undegraded":"2023-12-19T13:33:09.466616+0000","last_fullsized":"2023-12-19T13:33:09.466616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:05.364189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466126+0000","last_change":"2023-12-19T13:33:07.670225+0000","last_active":"2023-12-19T13:33:09.466126+0000","last_peered":"2023-12-19T13:33:09.466126+0000","last_clean":"2023-12-19T13:33:09.466126+0000","last_became_active":"2023-12-19T13:33:07.669851+0000","last_became_peered":"2023-12-19T13:33:07.669851+0000","last_unstale":"2023-12-19T13:33:09.466126+0000","last_undegraded":"2023-12-19T13:33:09.466126+0000","last_fullsized":"2023-12-19T13:33:09.466126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467033+0000","last_change":"2023-12-19T13:33:08.056812+0000","last_active":"2023-12-19T13:33:09.467033+0000","last_peered":"2023-12-19T13:33:09.467033+0000","last_clean":"2023-12-19T13:33:09.467033+0000","last_became_active":"2023-12-19T13:33:08.056390+0000","last_became_peered":"2023-12-19T13:33:08.056390+0000","last_unstale":"2023-12-19T13:33:09.467033+0000","last_undegraded":"2023-12-19T13:33:09.467033+0000","last_fullsized":"2023-12-19T13:33:09.467033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:46.064148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:33:08.037035+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T13:33:08.037035+0000","last_peered":"2023-12-19T13:33:08.037035+0000","last_clean":"2023-12-19T13:33:08.037035+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T13:33:08.037035+0000","last_undegraded":"2023-12-19T13:33:08.037035+0000","last_fullsized":"2023-12-19T13:33:08.037035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466303+0000","last_change":"2023-12-19T13:33:07.669727+0000","last_active":"2023-12-19T13:33:09.466303+0000","last_peered":"2023-12-19T13:33:09.466303+0000","last_clean":"2023-12-19T13:33:09.466303+0000","last_became_active":"2023-12-19T13:33:07.669402+0000","last_became_peered":"2023-12-19T13:33:07.669402+0000","last_unstale":"2023-12-19T13:33:09.466303+0000","last_undegraded":"2023-12-19T13:33:09.466303+0000","last_fullsized":"2023-12-19T13:33:09.466303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466755+0000","last_change":"2023-12-19T13:33:08.053509+0000","last_active":"2023-12-19T13:33:09.466755+0000","last_peered":"2023-12-19T13:33:09.466755+0000","last_clean":"2023-12-19T13:33:09.466755+0000","last_became_active":"2023-12-19T13:33:08.053242+0000","last_became_peered":"2023-12-19T13:33:08.053242+0000","last_unstale":"2023-12-19T13:33:09.466755+0000","last_undegraded":"2023-12-19T13:33:09.466755+0000","last_fullsized":"2023-12-19T13:33:09.466755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466114+0000","last_change":"2023-12-19T13:33:07.672010+0000","last_active":"2023-12-19T13:33:09.466114+0000","last_peered":"2023-12-19T13:33:09.466114+0000","last_clean":"2023-12-19T13:33:09.466114+0000","last_became_active":"2023-12-19T13:33:07.671753+0000","last_became_peered":"2023-12-19T13:33:07.671753+0000","last_unstale":"2023-12-19T13:33:09.466114+0000","last_undegraded":"2023-12-19T13:33:09.466114+0000","last_fullsized":"2023-12-19T13:33:09.466114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:32.366813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466752+0000","last_change":"2023-12-19T13:33:08.046756+0000","last_active":"2023-12-19T13:33:09.466752+0000","last_peered":"2023-12-19T13:33:09.466752+0000","last_clean":"2023-12-19T13:33:09.466752+0000","last_became_active":"2023-12-19T13:33:08.046513+0000","last_became_peered":"2023-12-19T13:33:08.046513+0000","last_unstale":"2023-12-19T13:33:09.466752+0000","last_undegraded":"2023-12-19T13:33:09.466752+0000","last_fullsized":"2023-12-19T13:33:09.466752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466102+0000","last_change":"2023-12-19T13:33:07.666893+0000","last_active":"2023-12-19T13:33:09.466102+0000","last_peered":"2023-12-19T13:33:09.466102+0000","last_clean":"2023-12-19T13:33:09.466102+0000","last_became_active":"2023-12-19T13:33:07.666570+0000","last_became_peered":"2023-12-19T13:33:07.666570+0000","last_unstale":"2023-12-19T13:33:09.466102+0000","last_undegraded":"2023-12-19T13:33:09.466102+0000","last_fullsized":"2023-12-19T13:33:09.466102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037791+0000","last_change":"2023-12-19T13:33:08.044537+0000","last_active":"2023-12-19T13:33:09.037791+0000","last_peered":"2023-12-19T13:33:09.037791+0000","last_clean":"2023-12-19T13:33:09.037791+0000","last_became_active":"2023-12-19T13:33:08.043564+0000","last_became_peered":"2023-12-19T13:33:08.043564+0000","last_unstale":"2023-12-19T13:33:09.037791+0000","last_undegraded":"2023-12-19T13:33:09.037791+0000","last_fullsized":"2023-12-19T13:33:09.037791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466693+0000","last_change":"2023-12-19T13:33:07.671346+0000","last_active":"2023-12-19T13:33:09.466693+0000","last_peered":"2023-12-19T13:33:09.466693+0000","last_clean":"2023-12-19T13:33:09.466693+0000","last_became_active":"2023-12-19T13:33:07.670835+0000","last_became_peered":"2023-12-19T13:33:07.670835+0000","last_unstale":"2023-12-19T13:33:09.466693+0000","last_undegraded":"2023-12-19T13:33:09.466693+0000","last_fullsized":"2023-12-19T13:33:09.466693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039595+0000","last_change":"2023-12-19T13:33:08.052676+0000","last_active":"2023-12-19T13:33:09.039595+0000","last_peered":"2023-12-19T13:33:09.039595+0000","last_clean":"2023-12-19T13:33:09.039595+0000","last_became_active":"2023-12-19T13:33:08.052415+0000","last_became_peered":"2023-12-19T13:33:08.052415+0000","last_unstale":"2023-12-19T13:33:09.039595+0000","last_undegraded":"2023-12-19T13:33:09.039595+0000","last_fullsized":"2023-12-19T13:33:09.039595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:52.562074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037987+0000","last_change":"2023-12-19T13:33:07.668666+0000","last_active":"2023-12-19T13:33:09.037987+0000","last_peered":"2023-12-19T13:33:09.037987+0000","last_clean":"2023-12-19T13:33:09.037987+0000","last_became_active":"2023-12-19T13:33:07.668398+0000","last_became_peered":"2023-12-19T13:33:07.668398+0000","last_unstale":"2023-12-19T13:33:09.037987+0000","last_undegraded":"2023-12-19T13:33:09.037987+0000","last_fullsized":"2023-12-19T13:33:09.037987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467057+0000","last_change":"2023-12-19T13:33:08.058068+0000","last_active":"2023-12-19T13:33:09.467057+0000","last_peered":"2023-12-19T13:33:09.467057+0000","last_clean":"2023-12-19T13:33:09.467057+0000","last_became_active":"2023-12-19T13:33:08.057740+0000","last_became_peered":"2023-12-19T13:33:08.057740+0000","last_unstale":"2023-12-19T13:33:09.467057+0000","last_undegraded":"2023-12-19T13:33:09.467057+0000","last_fullsized":"2023-12-19T13:33:09.467057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467178+0000","last_change":"2023-12-19T13:33:07.675084+0000","last_active":"2023-12-19T13:33:09.467178+0000","last_peered":"2023-12-19T13:33:09.467178+0000","last_clean":"2023-12-19T13:33:09.467178+0000","last_became_active":"2023-12-19T13:33:07.674840+0000","last_became_peered":"2023-12-19T13:33:07.674840+0000","last_unstale":"2023-12-19T13:33:09.467178+0000","last_undegraded":"2023-12-19T13:33:09.467178+0000","last_fullsized":"2023-12-19T13:33:09.467178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037889+0000","last_change":"2023-12-19T13:33:08.043314+0000","last_active":"2023-12-19T13:33:09.037889+0000","last_peered":"2023-12-19T13:33:09.037889+0000","last_clean":"2023-12-19T13:33:09.037889+0000","last_became_active":"2023-12-19T13:33:08.043051+0000","last_became_peered":"2023-12-19T13:33:08.043051+0000","last_unstale":"2023-12-19T13:33:09.037889+0000","last_undegraded":"2023-12-19T13:33:09.037889+0000","last_fullsized":"2023-12-19T13:33:09.037889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037989+0000","last_change":"2023-12-19T13:33:07.665299+0000","last_active":"2023-12-19T13:33:09.037989+0000","last_peered":"2023-12-19T13:33:09.037989+0000","last_clean":"2023-12-19T13:33:09.037989+0000","last_became_active":"2023-12-19T13:33:07.665030+0000","last_became_peered":"2023-12-19T13:33:07.665030+0000","last_unstale":"2023-12-19T13:33:09.037989+0000","last_undegraded":"2023-12-19T13:33:09.037989+0000","last_fullsized":"2023-12-19T13:33:09.037989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466907+0000","last_change":"2023-12-19T13:33:08.050353+0000","last_active":"2023-12-19T13:33:09.466907+0000","last_peered":"2023-12-19T13:33:09.466907+0000","last_clean":"2023-12-19T13:33:09.466907+0000","last_became_active":"2023-12-19T13:33:08.050051+0000","last_became_peered":"2023-12-19T13:33:08.050051+0000","last_unstale":"2023-12-19T13:33:09.466907+0000","last_undegraded":"2023-12-19T13:33:09.466907+0000","last_fullsized":"2023-12-19T13:33:09.466907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:10.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039345+0000","last_change":"2023-12-19T13:33:07.668359+0000","last_active":"2023-12-19T13:33:09.039345+0000","last_peered":"2023-12-19T13:33:09.039345+0000","last_clean":"2023-12-19T13:33:09.039345+0000","last_became_active":"2023-12-19T13:33:07.668113+0000","last_became_peered":"2023-12-19T13:33:07.668113+0000","last_unstale":"2023-12-19T13:33:09.039345+0000","last_undegraded":"2023-12-19T13:33:09.039345+0000","last_fullsized":"2023-12-19T13:33:09.039345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467364+0000","last_change":"2023-12-19T13:33:08.047035+0000","last_active":"2023-12-19T13:33:09.467364+0000","last_peered":"2023-12-19T13:33:09.467364+0000","last_clean":"2023-12-19T13:33:09.467364+0000","last_became_active":"2023-12-19T13:33:08.045656+0000","last_became_peered":"2023-12-19T13:33:08.045656+0000","last_unstale":"2023-12-19T13:33:09.467364+0000","last_undegraded":"2023-12-19T13:33:09.467364+0000","last_fullsized":"2023-12-19T13:33:09.467364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466112+0000","last_change":"2023-12-19T13:33:07.676027+0000","last_active":"2023-12-19T13:33:09.466112+0000","last_peered":"2023-12-19T13:33:09.466112+0000","last_clean":"2023-12-19T13:33:09.466112+0000","last_became_active":"2023-12-19T13:33:07.675643+0000","last_became_peered":"2023-12-19T13:33:07.675643+0000","last_unstale":"2023-12-19T13:33:09.466112+0000","last_undegraded":"2023-12-19T13:33:09.466112+0000","last_fullsized":"2023-12-19T13:33:09.466112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039707+0000","last_change":"2023-12-19T13:33:08.044642+0000","last_active":"2023-12-19T13:33:09.039707+0000","last_peered":"2023-12-19T13:33:09.039707+0000","last_clean":"2023-12-19T13:33:09.039707+0000","last_became_active":"2023-12-19T13:33:08.044393+0000","last_became_peered":"2023-12-19T13:33:08.044393+0000","last_unstale":"2023-12-19T13:33:09.039707+0000","last_undegraded":"2023-12-19T13:33:09.039707+0000","last_fullsized":"2023-12-19T13:33:09.039707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:13.074479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037873+0000","last_change":"2023-12-19T13:33:07.672222+0000","last_active":"2023-12-19T13:33:09.037873+0000","last_peered":"2023-12-19T13:33:09.037873+0000","last_clean":"2023-12-19T13:33:09.037873+0000","last_became_active":"2023-12-19T13:33:07.671916+0000","last_became_peered":"2023-12-19T13:33:07.671916+0000","last_unstale":"2023-12-19T13:33:09.037873+0000","last_undegraded":"2023-12-19T13:33:09.037873+0000","last_fullsized":"2023-12-19T13:33:09.037873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466479+0000","last_change":"2023-12-19T13:33:08.046213+0000","last_active":"2023-12-19T13:33:09.466479+0000","last_peered":"2023-12-19T13:33:09.466479+0000","last_clean":"2023-12-19T13:33:09.466479+0000","last_became_active":"2023-12-19T13:33:08.045740+0000","last_became_peered":"2023-12-19T13:33:08.045740+0000","last_unstale":"2023-12-19T13:33:09.466479+0000","last_undegraded":"2023-12-19T13:33:09.466479+0000","last_fullsized":"2023-12-19T13:33:09.466479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037969+0000","last_change":"2023-12-19T13:33:07.674107+0000","last_active":"2023-12-19T13:33:09.037969+0000","last_peered":"2023-12-19T13:33:09.037969+0000","last_clean":"2023-12-19T13:33:09.037969+0000","last_became_active":"2023-12-19T13:33:07.673826+0000","last_became_peered":"2023-12-19T13:33:07.673826+0000","last_unstale":"2023-12-19T13:33:09.037969+0000","last_undegraded":"2023-12-19T13:33:09.037969+0000","last_fullsized":"2023-12-19T13:33:09.037969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466593+0000","last_change":"2023-12-19T13:33:08.053691+0000","last_active":"2023-12-19T13:33:09.466593+0000","last_peered":"2023-12-19T13:33:09.466593+0000","last_clean":"2023-12-19T13:33:09.466593+0000","last_became_active":"2023-12-19T13:33:08.052956+0000","last_became_peered":"2023-12-19T13:33:08.052956+0000","last_unstale":"2023-12-19T13:33:09.466593+0000","last_undegraded":"2023-12-19T13:33:09.466593+0000","last_fullsized":"2023-12-19T13:33:09.466593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466990+0000","last_change":"2023-12-19T13:33:07.673744+0000","last_active":"2023-12-19T13:33:09.466990+0000","last_peered":"2023-12-19T13:33:09.466990+0000","last_clean":"2023-12-19T13:33:09.466990+0000","last_became_active":"2023-12-19T13:33:07.673350+0000","last_became_peered":"2023-12-19T13:33:07.673350+0000","last_unstale":"2023-12-19T13:33:09.466990+0000","last_undegraded":"2023-12-19T13:33:09.466990+0000","last_fullsized":"2023-12-19T13:33:09.466990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:51.556658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038917+0000","last_change":"2023-12-19T13:33:08.047155+0000","last_active":"2023-12-19T13:33:09.038917+0000","last_peered":"2023-12-19T13:33:09.038917+0000","last_clean":"2023-12-19T13:33:09.038917+0000","last_became_active":"2023-12-19T13:33:08.046913+0000","last_became_peered":"2023-12-19T13:33:08.046913+0000","last_unstale":"2023-12-19T13:33:09.038917+0000","last_undegraded":"2023-12-19T13:33:09.038917+0000","last_fullsized":"2023-12-19T13:33:09.038917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:00:30.701307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466703+0000","last_change":"2023-12-19T13:33:08.059339+0000","last_active":"2023-12-19T13:33:09.466703+0000","last_peered":"2023-12-19T13:33:09.466703+0000","last_clean":"2023-12-19T13:33:09.466703+0000","last_became_active":"2023-12-19T13:33:08.059075+0000","last_became_peered":"2023-12-19T13:33:08.059075+0000","last_unstale":"2023-12-19T13:33:09.466703+0000","last_undegraded":"2023-12-19T13:33:09.466703+0000","last_fullsized":"2023-12-19T13:33:09.466703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466938+0000","last_change":"2023-12-19T13:33:07.672573+0000","last_active":"2023-12-19T13:33:09.466938+0000","last_peered":"2023-12-19T13:33:09.466938+0000","last_clean":"2023-12-19T13:33:09.466938+0000","last_became_active":"2023-12-19T13:33:07.672300+0000","last_became_peered":"2023-12-19T13:33:07.672300+0000","last_unstale":"2023-12-19T13:33:09.466938+0000","last_undegraded":"2023-12-19T13:33:09.466938+0000","last_fullsized":"2023-12-19T13:33:09.466938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:17:52.424628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466505+0000","last_change":"2023-12-19T13:33:08.059145+0000","last_active":"2023-12-19T13:33:09.466505+0000","last_peered":"2023-12-19T13:33:09.466505+0000","last_clean":"2023-12-19T13:33:09.466505+0000","last_became_active":"2023-12-19T13:33:08.058854+0000","last_became_peered":"2023-12-19T13:33:08.058854+0000","last_unstale":"2023-12-19T13:33:09.466505+0000","last_undegraded":"2023-12-19T13:33:09.466505+0000","last_fullsized":"2023-12-19T13:33:09.466505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467092+0000","last_change":"2023-12-19T13:33:07.670541+0000","last_active":"2023-12-19T13:33:09.467092+0000","last_peered":"2023-12-19T13:33:09.467092+0000","last_clean":"2023-12-19T13:33:09.467092+0000","last_became_active":"2023-12-19T13:33:07.670255+0000","last_became_peered":"2023-12-19T13:33:07.670255+0000","last_unstale":"2023-12-19T13:33:09.467092+0000","last_undegraded":"2023-12-19T13:33:09.467092+0000","last_fullsized":"2023-12-19T13:33:09.467092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467194+0000","last_change":"2023-12-19T13:33:08.056004+0000","last_active":"2023-12-19T13:33:09.467194+0000","last_peered":"2023-12-19T13:33:09.467194+0000","last_clean":"2023-12-19T13:33:09.467194+0000","last_became_active":"2023-12-19T13:33:08.055703+0000","last_became_peered":"2023-12-19T13:33:08.055703+0000","last_unstale":"2023-12-19T13:33:09.467194+0000","last_undegraded":"2023-12-19T13:33:09.467194+0000","last_fullsized":"2023-12-19T13:33:09.467194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467024+0000","last_change":"2023-12-19T13:33:07.675986+0000","last_active":"2023-12-19T13:33:09.467024+0000","last_peered":"2023-12-19T13:33:09.467024+0000","last_clean":"2023-12-19T13:33:09.467024+0000","last_became_active":"2023-12-19T13:33:07.675686+0000","last_became_peered":"2023-12-19T13:33:07.675686+0000","last_unstale":"2023-12-19T13:33:09.467024+0000","last_undegraded":"2023-12-19T13:33:09.467024+0000","last_fullsized":"2023-12-19T13:33:09.467024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466896+0000","last_change":"2023-12-19T13:33:08.045717+0000","last_active":"2023-12-19T13:33:09.466896+0000","last_peered":"2023-12-19T13:33:09.466896+0000","last_clean":"2023-12-19T13:33:09.466896+0000","last_became_active":"2023-12-19T13:33:08.045449+0000","last_became_peered":"2023-12-19T13:33:08.045449+0000","last_unstale":"2023-12-19T13:33:09.466896+0000","last_undegraded":"2023-12-19T13:33:09.466896+0000","last_fullsized":"2023-12-19T13:33:09.466896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467371+0000","last_change":"2023-12-19T13:33:07.673708+0000","last_active":"2023-12-19T13:33:09.467371+0000","last_peered":"2023-12-19T13:33:09.467371+0000","last_clean":"2023-12-19T13:33:09.467371+0000","last_became_active":"2023-12-19T13:33:07.673458+0000","last_became_peered":"2023-12-19T13:33:07.673458+0000","last_unstale":"2023-12-19T13:33:09.467371+0000","last_undegraded":"2023-12-19T13:33:09.467371+0000","last_fullsized":"2023-12-19T13:33:09.467371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T13:33:12.012 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:33:12.012 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T13:33:12.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T13:33:12.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T13:33:12.013 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T13:33:12.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.152+0000 7fc94aeec640 1 Processor -- start 2023-12-19T13:33:12.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.152+0000 7fc94aeec640 1 -- start start 2023-12-19T13:33:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc94aeec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc94406a170 0x7fc9441564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc94aeec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94414bbe0 con 0x7fc944069d00 2023-12-19T13:33:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc94aeec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94414b750 con 0x7fc944145110 2023-12-19T13:33:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc94aeec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc944070a60 con 0x7fc94406a170 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc943fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc944069d00 0x7fc9440b7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56294/0 (socket says 172.21.15.6:56294) 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc943fff640 1 -- 172.21.15.6:0/850611671 learned_addr learned my addr 172.21.15.6:0/850611671 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127419039 0 0) 0x7fc94414bbe0 con 0x7fc944069d00 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc949489640 1 --2- 172.21.15.6:0/850611671 >> v2:172.21.15.89:3300/0 conn(0x7fc94406a170 0x7fc9441564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc934003520 con 0x7fc944069d00 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3978086095 0 0) 0x7fc934003520 con 0x7fc944069d00 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 >> v2:172.21.15.89:3300/0 conn(0x7fc94406a170 msgr2=0x7fc9441564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 --2- 172.21.15.6:0/850611671 >> v2:172.21.15.89:3300/0 conn(0x7fc94406a170 0x7fc9441564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 >> v1:172.21.15.89:6789/0 conn(0x7fc944145110 legacy=0x7fc944070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94414ae20 con 0x7fc944069d00 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fc930001670 con 0x7fc944069d00 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 >> v1:172.21.15.6:6789/0 conn(0x7fc944069d00 legacy=0x7fc9440b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc934003970 0x7fc934003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc934004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc934005180 0x7fc93400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc944070a60 con 0x7fc9340047c0 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.153+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93400c120 con 0x7fc934003970 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93400c2e0 con 0x7fc934005180 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc943fff640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc934004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc948c88640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc934003970 0x7fc934003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc949489640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc934005180 0x7fc93400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc943fff640 1 -- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc934005180 msgr2=0x7fc93400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc943fff640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc934005180 0x7fc93400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc943fff640 1 -- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc934003970 msgr2=0x7fc934003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc943fff640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc934003970 0x7fc934003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc943fff640 1 -- 172.21.15.6:0/850611671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934003520 con 0x7fc9340047c0 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.154+0000 7fc949489640 1 -- 172.21.15.6:0/850611671 reap_dead start 2023-12-19T13:33:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc943fff640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc934004c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c190 tx=0x7fc9340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77492b98ecb15ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930005ad0 con 0x7fc9340047c0 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc930005c30 con 0x7fc9340047c0 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc9437fe640 1 -- 172.21.15.6:0/850611671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93002ca70 con 0x7fc9340047c0 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 -- 172.21.15.6:0/850611671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 msgr2=0x7fc934004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc934004c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c190 tx=0x7fc9340057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 -- 172.21.15.6:0/850611671 shutdown_connections 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 --2- 172.21.15.6:0/850611671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc934004c40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 -- 172.21.15.6:0/850611671 >> 172.21.15.6:0/850611671 conn(0x7fc9440bd060 msgr2=0x7fc9440bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 -- 172.21.15.6:0/850611671 shutdown_connections 2023-12-19T13:33:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.155+0000 7fc94aeec640 1 -- 172.21.15.6:0/850611671 wait complete. 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.156+0000 7fc94aeec640 1 Processor -- start 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.156+0000 7fc94aeec640 1 -- start start 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc94aeec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc9441425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc94aeec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9441e3240 0x7fc9441e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc94aeec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9441d1a30 0x7fc9441d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc94aeec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9441d17d0 con 0x7fc9340047c0 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc94aeec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9441d0d30 con 0x7fc9441e3240 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc94aeec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9441d27b0 con 0x7fc9441d1a30 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc9441425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc9441425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34318/0 (socket says 172.21.15.6:34318) 2023-12-19T13:33:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 -- 172.21.15.6:0/322844297 learned_addr learned my addr 172.21.15.6:0/322844297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc943fff640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9441e3240 0x7fc9441e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc949489640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9441d1a30 0x7fc9441d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 -- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9441d1a30 msgr2=0x7fc9441d1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9441d1a30 0x7fc9441d1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 -- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9441e3240 msgr2=0x7fc9441e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9441e3240 0x7fc9441e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc948c88640 1 -- 172.21.15.6:0/322844297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9441d0fd0 con 0x7fc9340047c0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.157+0000 7fc949489640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9441d1a30 0x7fc9441d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.158+0000 7fc948c88640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc9441425e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc93800f540 tx=0x7fc93800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.158+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380052e0 con 0x7fc9340047c0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.158+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938005440 con 0x7fc9340047c0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.158+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9441d12b0 con 0x7fc9340047c0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.158+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938003830 con 0x7fc9340047c0 2023-12-19T13:33:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.158+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9441d23f0 con 0x7fc9340047c0 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.159+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc944073a40 con 0x7fc9340047c0 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.159+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc938003990 con 0x7fc9340047c0 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.160+0000 7fc9417fa640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc92806a430 0x7fc92806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.160+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc938088660 con 0x7fc9340047c0 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.160+0000 7fc943fff640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc92806a430 0x7fc92806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.160+0000 7fc943fff640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc92806a430 0x7fc92806c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc930034000 tx=0x7fc930009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.164+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc938053ce0 con 0x7fc9340047c0 2023-12-19T13:33:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.388+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc9440bdca0 con 0x7fc9340047c0 2023-12-19T13:33:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.391+0000 7fc9417fa640 1 -- 172.21.15.6:0/322844297 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169961 (secure 0 0 0) 0x7fc938057300 con 0x7fc9340047c0 2023-12-19T13:33:12.395 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc92806a430 msgr2=0x7fc92806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc92806a430 0x7fc92806c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc930034000 tx=0x7fc930009030 comp rx=0 tx=0).stop 2023-12-19T13:33:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 msgr2=0x7fc9441425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc9441425e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc93800f540 tx=0x7fc93800fa00 comp rx=0 tx=0).stop 2023-12-19T13:33:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 shutdown_connections 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc92806a430 0x7fc92806c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9441d1a30 0x7fc9441d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9441e3240 0x7fc9441e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 --2- 172.21.15.6:0/322844297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9340047c0 0x7fc9441425e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 >> 172.21.15.6:0/322844297 conn(0x7fc9440bd060 msgr2=0x7fc94406ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 shutdown_connections 2023-12-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.393+0000 7fc94aeec640 1 -- 172.21.15.6:0/322844297 wait complete. 2023-12-19T13:33:12.406 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":88967},{"type":"v1","addr":"172.21.15.89:6833","nonce":88967}]},"active_addr":"172.21.15.89:6833/88967","active_change":"2023-12-19T13:32:47.940848+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":344899674}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":107663156}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1816089121}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1504833105}]}]} 2023-12-19T13:33:12.409 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T13:33:12.409 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T13:33:12.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.512+0000 7ff4b90b6640 1 Processor -- start 2023-12-19T13:33:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.512+0000 7ff4b90b6640 1 -- start start 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b90b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff4b406a170 0x7ff4b41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b90b6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b414bbe0 con 0x7ff4b4069d00 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b90b6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b414b750 con 0x7ff4b4145110 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b90b6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b4070a60 con 0x7ff4b406a170 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4b4069d00 0x7ff4b40b7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56300/0 (socket says 172.21.15.6:56300) 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b259c640 1 -- 172.21.15.6:0/3084960835 learned_addr learned my addr 172.21.15.6:0/3084960835 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b359e640 1 --2- 172.21.15.6:0/3084960835 >> v2:172.21.15.89:3300/0 conn(0x7ff4b406a170 0x7ff4b41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b1d9b640 1 -- 172.21.15.6:0/3084960835 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218840527 0 0) 0x7ff4b414bbe0 con 0x7ff4b4069d00 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.513+0000 7ff4b1d9b640 1 -- 172.21.15.6:0/3084960835 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c003520 con 0x7ff4b4069d00 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.514+0000 7ff4b359e640 1 -- 172.21.15.6:0/3084960835 >> v1:172.21.15.89:6789/0 conn(0x7ff4b4145110 legacy=0x7ff4b4070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.514+0000 7ff4b359e640 1 -- 172.21.15.6:0/3084960835 >> v1:172.21.15.6:6789/0 conn(0x7ff4b4069d00 legacy=0x7ff4b40b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.514+0000 7ff4b359e640 1 -- 172.21.15.6:0/3084960835 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b414ae20 con 0x7ff4b406a170 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.514+0000 7ff4b359e640 1 --2- 172.21.15.6:0/3084960835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b406a170 0x7ff4b41564c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009d90 tx=0x7ff4a402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d6168f796e001f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b1d9b640 1 -- 172.21.15.6:0/3084960835 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a402cc60 con 0x7ff4b406a170 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b1d9b640 1 -- 172.21.15.6:0/3084960835 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a402cdc0 con 0x7ff4b406a170 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b1d9b640 1 -- 172.21.15.6:0/3084960835 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4034640 con 0x7ff4b406a170 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 -- 172.21.15.6:0/3084960835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b406a170 msgr2=0x7ff4b41564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/3084960835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b406a170 0x7ff4b41564c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009d90 tx=0x7ff4a402beb0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 -- 172.21.15.6:0/3084960835 shutdown_connections 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/3084960835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b406a170 0x7ff4b41564c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 -- 172.21.15.6:0/3084960835 >> 172.21.15.6:0/3084960835 conn(0x7ff4b40bd060 msgr2=0x7ff4b40bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 -- 172.21.15.6:0/3084960835 shutdown_connections 2023-12-19T13:33:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.515+0000 7ff4b90b6640 1 -- 172.21.15.6:0/3084960835 wait complete. 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.516+0000 7ff4b90b6640 1 Processor -- start 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.516+0000 7ff4b90b6640 1 -- start start 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b90b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4b4069d00 0x7ff4b41457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b90b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 0x7ff4b4141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b90b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b4145110 0x7ff4b4142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b90b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4145d30 con 0x7ff4b406a170 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b90b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4145ee0 con 0x7ff4b4145110 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b90b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4147500 con 0x7ff4b4069d00 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 0x7ff4b4141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 0x7ff4b4141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34334/0 (socket says 172.21.15.6:34334) 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 -- 172.21.15.6:0/1280287323 learned_addr learned my addr 172.21.15.6:0/1280287323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b2d9d640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4b4069d00 0x7ff4b41457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b359e640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b4145110 0x7ff4b4142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 -- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4b4069d00 msgr2=0x7ff4b41457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4b4069d00 0x7ff4b41457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 -- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b4145110 msgr2=0x7ff4b4142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.517+0000 7ff4b259c640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b4145110 0x7ff4b4142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff4b259c640 1 -- 172.21.15.6:0/1280287323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009a70 con 0x7ff4b406a170 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff4b2d9d640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4b4069d00 0x7ff4b41457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff4b359e640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b4145110 0x7ff4b4142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff4b259c640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 0x7ff4b4141f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800c500 tx=0x7ff4a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8005ce0 con 0x7ff4b406a170 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a8005e40 con 0x7ff4b406a170 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8007330 con 0x7ff4b406a170 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b41477e0 con 0x7ff4b406a170 2023-12-19T13:33:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.518+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40b6490 con 0x7ff4b406a170 2023-12-19T13:33:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.519+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b4147d00 con 0x7ff4b406a170 2023-12-19T13:33:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.519+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4a8007550 con 0x7ff4b406a170 2023-12-19T13:33:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.520+0000 7ff49b7fe640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff4a006a430 0x7ff4a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.520+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4a8087f70 con 0x7ff4b406a170 2023-12-19T13:33:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.520+0000 7ff4b2d9d640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff4a006a430 0x7ff4a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.520+0000 7ff4b2d9d640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff4a006a430 0x7ff4a006c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac001660 tx=0x7ff4ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.524+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4a80bac80 con 0x7ff4b406a170 2023-12-19T13:33:12.630 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-12-19T13:33:12.629+0000 7f991da7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:33:12.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.700+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4b4073a40 con 0x7ff4b406a170 2023-12-19T13:33:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.702+0000 7ff49b7fe640 1 -- 172.21.15.6:0/1280287323 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7ff4a8017090 con 0x7ff4b406a170 2023-12-19T13:33:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:12.704 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff4a006a430 msgr2=0x7ff4a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff4a006a430 0x7ff4a006c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac001660 tx=0x7ff4ac009040 comp rx=0 tx=0).stop 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 msgr2=0x7ff4b4141f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 0x7ff4b4141f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800c500 tx=0x7ff4a800c9c0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 shutdown_connections 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff4a006a430 0x7ff4a006c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b4145110 0x7ff4b4142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b406a170 0x7ff4b4141f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 --2- 172.21.15.6:0/1280287323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4b4069d00 0x7ff4b41457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.703+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 >> 172.21.15.6:0/1280287323 conn(0x7ff4b40bd060 msgr2=0x7ff4b406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.704+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 shutdown_connections 2023-12-19T13:33:12.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.704+0000 7ff4b90b6640 1 -- 172.21.15.6:0/1280287323 wait complete. 2023-12-19T13:33:12.716 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T13:33:12.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.820+0000 7f1b525f6640 1 Processor -- start 2023-12-19T13:33:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.820+0000 7f1b525f6640 1 -- start start 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.820+0000 7f1b525f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b4c06a6d0 0x7f1b4c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.820+0000 7f1b525f6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.820+0000 7f1b525f6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0bb310 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.820+0000 7f1b525f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c0bf960 con 0x7f1b4c06a6d0 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b525f6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0bb5b0 con 0x7f1b4c0ba550 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b4c06a6d0 0x7f1b4c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b4c06a6d0 0x7f1b4c14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34344/0 (socket says 172.21.15.6:34344) 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 -- 172.21.15.6:0/3134605692 learned_addr learned my addr 172.21.15.6:0/3134605692 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b50b93640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 -- 172.21.15.6:0/3134605692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 msgr2=0x7f1b4c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 -- 172.21.15.6:0/3134605692 >> v1:172.21.15.89:6789/0 conn(0x7f1b4c14b1f0 legacy=0x7f1b4c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b4bfff640 1 -- 172.21.15.6:0/3134605692 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0c0120 con 0x7f1b4c06a6d0 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.821+0000 7f1b50b93640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b4bfff640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c14acb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009870 tx=0x7f1b4002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b00404e2f1254c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b4affd640 1 -- 172.21.15.6:0/3134605692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40031640 con 0x7f1b4c06a6d0 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b4affd640 1 -- 172.21.15.6:0/3134605692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b400317a0 con 0x7f1b4c06a6d0 2023-12-19T13:33:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b4affd640 1 -- 172.21.15.6:0/3134605692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40031b30 con 0x7f1b4c06a6d0 2023-12-19T13:33:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 -- 172.21.15.6:0/3134605692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c06a6d0 msgr2=0x7f1b4c14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c14acb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009870 tx=0x7f1b4002b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 -- 172.21.15.6:0/3134605692 shutdown_connections 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 --2- 172.21.15.6:0/3134605692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c14acb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 -- 172.21.15.6:0/3134605692 >> 172.21.15.6:0/3134605692 conn(0x7f1b4c0c0350 msgr2=0x7f1b4c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 -- 172.21.15.6:0/3134605692 shutdown_connections 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.822+0000 7f1b525f6640 1 -- 172.21.15.6:0/3134605692 wait complete. 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.823+0000 7f1b525f6640 1 Processor -- start 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 -- start start 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 0x7f1b4c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b37d0 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0a5d80 con 0x7f1b4c06a6d0 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b525f6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c14a670 con 0x7f1b4c0ba550 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b50b93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 0x7f1b4c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b50b93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 0x7f1b4c14e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34360/0 (socket says 172.21.15.6:34360) 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.824+0000 7f1b50b93640 1 -- 172.21.15.6:0/1698189748 learned_addr learned my addr 172.21.15.6:0/1698189748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b4b7fe640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b4bfff640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b50b93640 1 -- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 msgr2=0x7f1b4c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b50b93640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c14dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b50b93640 1 -- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c06a6d0 msgr2=0x7f1b4c0a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b50b93640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c0a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b50b93640 1 -- 172.21.15.6:0/1698189748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400094d0 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b4bfff640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c0a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b50b93640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 0x7f1b4c14e010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400cea0 tx=0x7f1b4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003b90 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44003d10 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c14e710 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004260 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.825+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c14c800 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.826+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c14c520 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.827+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b440043c0 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.827+0000 7f1b48ff9640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b3806a430 0x7f1b3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.827+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b44089240 con 0x7f1b4c14b1f0 2023-12-19T13:33:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.827+0000 7f1b4bfff640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b3806a430 0x7f1b3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.828+0000 7f1b4bfff640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b3806a430 0x7f1b3806c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b40036000 tx=0x7f1b4003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:12.831+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1b4c14c520 con 0x7f1b4c14b1f0 2023-12-19T13:33:13.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.008+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b4c14c520 con 0x7f1b4c14b1f0 2023-12-19T13:33:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.009+0000 7f1b48ff9640 1 -- 172.21.15.6:0/1698189748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f1b4c14c520 con 0x7f1b4c14b1f0 2023-12-19T13:33:13.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:13.011 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:13.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b3806a430 msgr2=0x7f1b3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b3806a430 0x7f1b3806c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b40036000 tx=0x7f1b4003c040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 msgr2=0x7f1b4c14e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 0x7f1b4c14e010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400cea0 tx=0x7f1b4400cf90 comp rx=0 tx=0).stop 2023-12-19T13:33:13.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 shutdown_connections 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b3806a430 0x7f1b3806c8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b4c14b1f0 0x7f1b4c14e010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b4c0ba550 0x7f1b4c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 --2- 172.21.15.6:0/1698189748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b4c06a6d0 0x7f1b4c0a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 >> 172.21.15.6:0/1698189748 conn(0x7f1b4c0c0350 msgr2=0x7f1b4c146ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 shutdown_connections 2023-12-19T13:33:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.011+0000 7f1b525f6640 1 -- 172.21.15.6:0/1698189748 wait complete. 2023-12-19T13:33:13.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T13:33:13.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T13:33:13.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T13:33:13.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T13:33:13.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T13:33:13.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T13:33:13.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T13:33:13.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T13:33:13.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.206+0000 7fb4d03c9640 1 Processor -- start 2023-12-19T13:33:13.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.206+0000 7fb4d03c9640 1 -- start start 2023-12-19T13:33:13.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.207+0000 7fe6c648b640 1 Processor -- start 2023-12-19T13:33:13.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.207+0000 7fe6c648b640 1 -- start start 2023-12-19T13:33:13.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7f7f82d39640 1 Processor -- start 2023-12-19T13:33:13.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7fb4d03c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb4c80b3900 0x7fb4c8153030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7fb4d03c9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c8152ba0 con 0x7fb4c814efb0 2023-12-19T13:33:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7f97f2bd2640 1 Processor -- start 2023-12-19T13:33:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7fb4d03c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c80b9840 con 0x7fb4c80705d0 2023-12-19T13:33:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7fb4d03c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c814f3f0 con 0x7fb4c80b3900 2023-12-19T13:33:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7fb4cd964640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb4c814efb0 0x7fb4c806fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56310/0 (socket says 172.21.15.6:56310) 2023-12-19T13:33:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7fb4cd964640 1 -- 172.21.15.6:0/3004594742 learned_addr learned my addr 172.21.15.6:0/3004594742 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7f10815d9640 1 Processor -- start 2023-12-19T13:33:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7f10815d9640 1 -- start start 2023-12-19T13:33:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7f97f2bd2640 1 -- start start 2023-12-19T13:33:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6c648b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 0x7fe6c00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6c648b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c00b3900 con 0x7fe6c0149140 2023-12-19T13:33:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6c648b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c0071640 con 0x7fe6c006a500 2023-12-19T13:33:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6c648b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00b3ba0 con 0x7fe6c006a120 2023-12-19T13:33:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.208+0000 7f7f82d39640 1 -- start start 2023-12-19T13:33:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fb4ce165640 1 --2- 172.21.15.6:0/3004594742 >> v2:172.21.15.89:3300/0 conn(0x7fb4c80b3900 0x7fb4c8153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f82d39640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f7c0b5bf0 0x7f7f7c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f5c97727640 1 Processor -- start 2023-12-19T13:33:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f97f2bd2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f97f2bd2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97ec14a1e0 0x7f97ec14a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f97f2bd2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97ec070290 0x7f97ec070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f97f2bd2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec1412f0 con 0x7f97ec14a1e0 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f97f2bd2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec071090 con 0x7f97ec070290 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f97f2bd2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec06f210 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6bffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 0x7fe6c00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fb4cd163640 1 -- 172.21.15.6:0/3004594742 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427289621 0 0) 0x7fb4c80b9840 con 0x7fb4c80705d0 2023-12-19T13:33:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fb4cd163640 1 -- 172.21.15.6:0/3004594742 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b4003520 con 0x7fb4c80705d0 2023-12-19T13:33:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f5c97727640 1 -- start start 2023-12-19T13:33:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6bffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 0x7fe6c00b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34790/0 (socket says 172.21.15.6:34790) 2023-12-19T13:33:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7fe6bffff640 1 -- 172.21.15.6:0/1708618378 learned_addr learned my addr 172.21.15.6:0/1708618378 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f82d39640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f7c070290 0x7f7f7c070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97ec070290 0x7f97ec070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97ec070290 0x7f97ec070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:39918/0 (socket says 172.21.15.6:39918) 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 -- 172.21.15.6:0/284549284 learned_addr learned my addr 172.21.15.6:0/284549284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7fe6bffff640 1 -- 172.21.15.6:0/1708618378 >> v1:172.21.15.89:6789/0 conn(0x7fe6c006a500 legacy=0x7fe6c00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7fe6bffff640 1 -- 172.21.15.6:0/1708618378 >> v1:172.21.15.6:6789/0 conn(0x7fe6c0149140 legacy=0x7fe6c0153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7fe6bffff640 1 -- 172.21.15.6:0/1708618378 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00b3e80 con 0x7fe6c006a120 2023-12-19T13:33:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f82d39640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c06f210 con 0x7f7f7c14a1e0 2023-12-19T13:33:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f82d39640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c1412f0 con 0x7f7f7c0b5bf0 2023-12-19T13:33:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f82d39640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c071090 con 0x7f7f7c070290 2023-12-19T13:33:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f10815d9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f107c069f70 0x7f107c0b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f80ad5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f7c0b5bf0 0x7f7f7c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f80ad5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f7c0b5bf0 0x7f7f7c0b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34376/0 (socket says 172.21.15.6:34376) 2023-12-19T13:33:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f80ad5640 1 -- 172.21.15.6:0/3169300242 learned_addr learned my addr 172.21.15.6:0/3169300242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f80ad5640 1 -- 172.21.15.6:0/3169300242 >> v2:172.21.15.89:3300/0 conn(0x7f7f7c070290 msgr2=0x7f7f7c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.209+0000 7f7f80ad5640 1 --2- 172.21.15.6:0/3169300242 >> v2:172.21.15.89:3300/0 conn(0x7f7f7c070290 0x7f7f7c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f7f80ad5640 1 -- 172.21.15.6:0/3169300242 >> v1:172.21.15.89:6789/0 conn(0x7f7f7c14a1e0 legacy=0x7f7f7c14a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f7f80ad5640 1 -- 172.21.15.6:0/3169300242 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c06f4b0 con 0x7f7f7c0b5bf0 2023-12-19T13:33:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f096e640 1 --2- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f10815d9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c06b150 con 0x7f107c147d00 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f10815d9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c0b80b0 con 0x7f107c14e6e0 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f10815d9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c0b8390 con 0x7f107c069f70 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f107a7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f107c147d00 0x7f107c14dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56338/0 (socket says 172.21.15.6:56338) 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f107a7fc640 1 -- 172.21.15.6:0/639099623 learned_addr learned my addr 172.21.15.6:0/639099623 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f1dd59a4640 1 Processor -- start 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97ebfff640 1 --2- 172.21.15.6:0/284549284 >> v2:172.21.15.6:3300/0 conn(0x7f97ec14a1e0 0x7f97ec14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 -- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 msgr2=0x7f97ec0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 --2- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 -- 172.21.15.6:0/284549284 >> v2:172.21.15.6:3300/0 conn(0x7f97ec14a1e0 msgr2=0x7f97ec14a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 --2- 172.21.15.6:0/284549284 >> v2:172.21.15.6:3300/0 conn(0x7f97ec14a1e0 0x7f97ec14a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f97f116f640 1 -- 172.21.15.6:0/284549284 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec06f4b0 con 0x7f97ec070290 2023-12-19T13:33:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f97ebfff640 1 --2- 172.21.15.6:0/284549284 >> v2:172.21.15.6:3300/0 conn(0x7f97ec14a1e0 0x7f97ec14a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f5a3359e640 1 Processor -- start 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f5a3359e640 1 -- start start 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c97727640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006a390 0x7f5c9006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c97727640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c9006fa10 0x7f5c90148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c97727640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c90149430 0x7f5c900b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c97727640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c90070400 con 0x7f5c9006fa10 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c97727640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9006f670 con 0x7f5c90149430 2023-12-19T13:33:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c97727640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9006f1e0 con 0x7f5c9006a390 2023-12-19T13:33:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7fb4ce165640 1 -- 172.21.15.6:0/3004594742 >> v1:172.21.15.89:6789/0 conn(0x7fb4c80705d0 legacy=0x7fb4c81597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7fb4ce165640 1 -- 172.21.15.6:0/3004594742 >> v1:172.21.15.6:6789/0 conn(0x7fb4c814efb0 legacy=0x7fb4c806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7fb4ce165640 1 -- 172.21.15.6:0/3004594742 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80b3ce0 con 0x7fb4c80b3900 2023-12-19T13:33:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f107affd640 1 --2- 172.21.15.6:0/639099623 >> v2:172.21.15.89:3300/0 conn(0x7f107c069f70 0x7f107c0b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250327126 0 0) 0x7f107c0b80b0 con 0x7f107c14e6e0 2023-12-19T13:33:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1064003520 con 0x7f107c14e6e0 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7fb4ce165640 1 --2- 172.21.15.6:0/3004594742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c80b3900 0x7fb4c8153030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80097a0 tx=0x7fb4b802ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=befc152d33b738bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.210+0000 7f1dd59a4640 1 -- start start 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798013111 0 0) 0x7f1064003520 con 0x7f107c14e6e0 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 >> v2:172.21.15.89:3300/0 conn(0x7f107c069f70 msgr2=0x7f107c0b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 --2- 172.21.15.6:0/639099623 >> v2:172.21.15.89:3300/0 conn(0x7f107c069f70 0x7f107c0b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 >> v1:172.21.15.6:6789/0 conn(0x7f107c147d00 legacy=0x7f107c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c0b8670 con 0x7f107c14e6e0 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f1070001670 con 0x7f107c14e6e0 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 >> v1:172.21.15.89:6789/0 conn(0x7f107c14e6e0 legacy=0x7f107c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1064003970 0x7f1064003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640047c0 0x7f1064004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f1064014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0b8390 con 0x7f10640047c0 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640148a0 con 0x7f1064005180 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1064014a60 con 0x7f1064003970 2023-12-19T13:33:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c95cc4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c90149430 0x7f5c900b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f107bfff640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f1064014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f107a7fc640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640047c0 0x7f1064004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c954c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006a390 0x7f5c9006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f7f80ad5640 1 --2- 172.21.15.6:0/3169300242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 0x7f7f7c0b5fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c14ad10 tx=0x7f7f7402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce7c6a055a5e7f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c95cc4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c90149430 0x7f5c900b68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:39938/0 (socket says 172.21.15.6:39938) 2023-12-19T13:33:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c95cc4640 1 -- 172.21.15.6:0/1519547118 learned_addr learned my addr 172.21.15.6:0/1519547118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.211+0000 7f5c94cc2640 1 --2- 172.21.15.6:0/1519547118 >> v2:172.21.15.6:3300/0 conn(0x7f5c9006fa10 0x7f5c90148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f107affd640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1064003970 0x7f1064003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dd59a4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1dd00b7a40 0x7f1dd00b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f107bfff640 1 -- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1064003970 msgr2=0x7f1064003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f107bfff640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1064003970 0x7f1064003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f107bfff640 1 -- 172.21.15.6:0/639099623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640047c0 msgr2=0x7f1064004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f107bfff640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640047c0 0x7f1064004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dd59a4640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00b8ac0 con 0x7f1dd00bad10 2023-12-19T13:33:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dd59a4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd014abf0 con 0x7f1dd01410f0 2023-12-19T13:33:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dd59a4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00b8da0 con 0x7f1dd00b7a40 2023-12-19T13:33:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f107bfff640 1 -- 172.21.15.6:0/639099623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c0b8670 con 0x7f1064005180 2023-12-19T13:33:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7fb4cd163640 1 -- 172.21.15.6:0/3004594742 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b802f830 con 0x7fb4c80b3900 2023-12-19T13:33:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f97f116f640 1 --2- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec070700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0712e0 tx=0x7f97e402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df7bb764e8a23bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7fe6bffff640 1 --2- 172.21.15.6:0/1708618378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 0x7fe6c00b33c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e80 tx=0x7fe6b802bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ec21e8279bb637d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7fb4cd163640 1 -- 172.21.15.6:0/3004594742 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b802f990 con 0x7fb4c80b3900 2023-12-19T13:33:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a3359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a340b7860 0x7f5a3414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5c95cc4640 1 -- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006a390 msgr2=0x7f5c9006fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5c95cc4640 1 --2- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006a390 0x7f5c9006fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5c95cc4640 1 -- 172.21.15.6:0/1519547118 >> v2:172.21.15.6:3300/0 conn(0x7f5c9006fa10 msgr2=0x7f5c90148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5c95cc4640 1 --2- 172.21.15.6:0/1519547118 >> v2:172.21.15.6:3300/0 conn(0x7f5c9006fa10 0x7f5c90148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5c95cc4640 1 -- 172.21.15.6:0/1519547118 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900708e0 con 0x7f5c90149430 2023-12-19T13:33:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a3359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a340b8090 0x7f5a340b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f97eb7fe640 1 -- 172.21.15.6:0/284549284 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e402ca80 con 0x7f97ec070290 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f97eb7fe640 1 -- 172.21.15.6:0/284549284 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e402cbe0 con 0x7f97ec070290 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a3359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a34152c70 con 0x7f5a34148b10 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a3359e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a34152340 con 0x7f5a340b7860 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a3359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a34152620 con 0x7f5a340b8090 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a31d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5a34148b10 0x7f5a34148f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59720/0 (socket says 172.21.15.6:59720) 2023-12-19T13:33:13.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a31d9b640 1 -- 172.21.15.6:0/3784049783 learned_addr learned my addr 172.21.15.6:0/3784049783 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dcf7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1dd01410f0 0x7f1dd0155360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59708/0 (socket says 172.21.15.6:59708) 2023-12-19T13:33:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dcf7fe640 1 -- 172.21.15.6:0/23103159 learned_addr learned my addr 172.21.15.6:0/23103159 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f97eb7fe640 1 -- 172.21.15.6:0/284549284 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40343f0 con 0x7f97ec070290 2023-12-19T13:33:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f5a3259c640 1 --2- 172.21.15.6:0/3784049783 >> v2:172.21.15.6:3300/0 conn(0x7f5a340b7860 0x7f5a3414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.212+0000 7f1dceffd640 1 --2- 172.21.15.6:0/23103159 >> v2:172.21.15.6:3300/0 conn(0x7f1dd00b7a40 0x7f1dd00b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a32d9d640 1 --2- 172.21.15.6:0/3784049783 >> v2:172.21.15.89:3300/0 conn(0x7f5a340b8090 0x7f5a340b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3004594742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c80b3900 msgr2=0x7fb4c8153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 --2- 172.21.15.6:0/3004594742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c80b3900 0x7fb4c8153030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80097a0 tx=0x7fb4b802ba10 comp rx=0 tx=0).stop 2023-12-19T13:33:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f107bfff640 1 -- 172.21.15.6:0/639099623 reap_dead start 2023-12-19T13:33:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f1dceffd640 1 -- 172.21.15.6:0/23103159 >> v1:172.21.15.89:6789/0 conn(0x7f1dd01410f0 legacy=0x7f1dd0155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f1dceffd640 1 -- 172.21.15.6:0/23103159 >> v1:172.21.15.6:6789/0 conn(0x7f1dd00bad10 legacy=0x7f1dd014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f1dceffd640 1 -- 172.21.15.6:0/23103159 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd014aed0 con 0x7f1dd00b7a40 2023-12-19T13:33:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 -- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 msgr2=0x7f97ec070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec070700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0712e0 tx=0x7f97e402bee0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a3159a640 1 -- 172.21.15.6:0/3784049783 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849650001 0 0) 0x7f5a34152c70 con 0x7f5a34148b10 2023-12-19T13:33:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a3159a640 1 -- 172.21.15.6:0/3784049783 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a1c003520 con 0x7f5a34148b10 2023-12-19T13:33:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5c95cc4640 1 --2- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c90149430 0x7f5c900b68c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c9014cb80 tx=0x7f5c8c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b659f4d33e4bc7e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fe6beffd640 1 -- 172.21.15.6:0/1708618378 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b802cae0 con 0x7fe6c006a120 2023-12-19T13:33:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fe6beffd640 1 -- 172.21.15.6:0/1708618378 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b802cc40 con 0x7fe6c006a120 2023-12-19T13:33:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fe6beffd640 1 -- 172.21.15.6:0/1708618378 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80343f0 con 0x7fe6c006a120 2023-12-19T13:33:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3004594742 shutdown_connections 2023-12-19T13:33:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 --2- 172.21.15.6:0/3004594742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c80b3900 0x7fb4c8153030 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3004594742 >> 172.21.15.6:0/3004594742 conn(0x7fb4c806ae10 msgr2=0x7fb4c806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3004594742 shutdown_connections 2023-12-19T13:33:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f7f7b7fe640 1 -- 172.21.15.6:0/3169300242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7402ca80 con 0x7f7f7c0b5bf0 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 -- 172.21.15.6:0/284549284 shutdown_connections 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec070700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/284549284 >> v2:172.21.15.6:3300/0 conn(0x7f97ec14a1e0 0x7f97ec14a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/284549284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f97f2bd2640 1 -- 172.21.15.6:0/284549284 >> 172.21.15.6:0/284549284 conn(0x7f97ec0bc120 msgr2=0x7f97ec0bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f107bfff640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f1064014190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f107000c210 tx=0x7f10640057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d1054b3a22ea65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f97f2bd2640 1 -- 172.21.15.6:0/284549284 shutdown_connections 2023-12-19T13:33:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 -- 172.21.15.6:0/1708618378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 msgr2=0x7fe6c00b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 --2- 172.21.15.6:0/1708618378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 0x7fe6c00b33c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e80 tx=0x7fe6b802bf40 comp rx=0 tx=0).stop 2023-12-19T13:33:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3004594742 wait complete. 2023-12-19T13:33:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f97f2bd2640 1 -- 172.21.15.6:0/284549284 wait complete. 2023-12-19T13:33:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f5c87fff640 1 -- 172.21.15.6:0/1519547118 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0317e0 con 0x7f5c90149430 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f5c87fff640 1 -- 172.21.15.6:0/1519547118 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c031940 con 0x7f5c90149430 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f5c87fff640 1 -- 172.21.15.6:0/1519547118 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c031cf0 con 0x7f5c90149430 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107002ca50 con 0x7f1064005180 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107002cbd0 con 0x7f1064005180 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f1079ffb640 1 -- 172.21.15.6:0/639099623 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070034440 con 0x7f1064005180 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a3159a640 1 -- 172.21.15.6:0/3784049783 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243141413 0 0) 0x7f5a1c003520 con 0x7f5a34148b10 2023-12-19T13:33:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a3259c640 1 -- 172.21.15.6:0/3784049783 >> v2:172.21.15.89:3300/0 conn(0x7f5a340b8090 msgr2=0x7f5a340b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a3259c640 1 --2- 172.21.15.6:0/3784049783 >> v2:172.21.15.89:3300/0 conn(0x7f5a340b8090 0x7f5a340b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f5a3259c640 1 -- 172.21.15.6:0/3784049783 >> v1:172.21.15.89:6789/0 conn(0x7f5a34148b10 legacy=0x7f5a34148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f5a3259c640 1 -- 172.21.15.6:0/3784049783 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34152900 con 0x7f5a340b7860 2023-12-19T13:33:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.213+0000 7f7f7b7fe640 1 -- 172.21.15.6:0/3169300242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7402cbe0 con 0x7f7f7c0b5bf0 2023-12-19T13:33:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7f5a3259c640 1 --2- 172.21.15.6:0/3784049783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 0x7f5a3414ed70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a340ba7d0 tx=0x7f5a2402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5f358435e9ac2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 -- 172.21.15.6:0/1708618378 shutdown_connections 2023-12-19T13:33:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 --2- 172.21.15.6:0/1708618378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c006a120 0x7fe6c00b33c0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e80 tx=0x7fe6b802bf40 comp rx=0 tx=0).stop 2023-12-19T13:33:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 -- 172.21.15.6:0/1708618378 >> 172.21.15.6:0/1708618378 conn(0x7fe6c00bc330 msgr2=0x7fe6c00bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 -- 172.21.15.6:0/1708618378 shutdown_connections 2023-12-19T13:33:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.214+0000 7fe6c648b640 1 -- 172.21.15.6:0/1708618378 wait complete. 2023-12-19T13:33:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7fb4d03c9640 1 Processor -- start 2023-12-19T13:33:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f10815d9640 1 -- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 msgr2=0x7f1064014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f10815d9640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f1064014190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f107000c210 tx=0x7f10640057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 -- 172.21.15.6:0/3169300242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 msgr2=0x7f7f7c0b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 --2- 172.21.15.6:0/3169300242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 0x7f7f7c0b5fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c14ad10 tx=0x7f7f7402bee0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 -- 172.21.15.6:0/3169300242 shutdown_connections 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 --2- 172.21.15.6:0/3169300242 >> v2:172.21.15.89:3300/0 conn(0x7f7f7c070290 0x7f7f7c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 --2- 172.21.15.6:0/3169300242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 0x7f7f7c0b5fd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 -- 172.21.15.6:0/3169300242 >> 172.21.15.6:0/3169300242 conn(0x7f7f7c0bc120 msgr2=0x7f7f7c0bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f5a3159a640 1 -- 172.21.15.6:0/3784049783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28001670 con 0x7f5a340b7860 2023-12-19T13:33:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f5a3159a640 1 -- 172.21.15.6:0/3784049783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24031540 con 0x7f5a340b7860 2023-12-19T13:33:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f5a3159a640 1 -- 172.21.15.6:0/3784049783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240318d0 con 0x7f5a340b7860 2023-12-19T13:33:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f10815d9640 1 -- 172.21.15.6:0/639099623 shutdown_connections 2023-12-19T13:33:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f10815d9640 1 --2- 172.21.15.6:0/639099623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f1064014190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f10815d9640 1 -- 172.21.15.6:0/639099623 >> 172.21.15.6:0/639099623 conn(0x7f107c0bd870 msgr2=0x7f107c0bdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7fb4d03c9640 1 -- start start 2023-12-19T13:33:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f5a32d9d640 1 --2- 172.21.15.6:0/3784049783 >> v2:172.21.15.89:3300/0 conn(0x7f5a340b8090 0x7f5a340b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f97f2bd2640 1 Processor -- start 2023-12-19T13:33:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f97f2bd2640 1 -- start start 2023-12-19T13:33:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f1dceffd640 1 --2- 172.21.15.6:0/23103159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b7a40 0x7f1dd00b83f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097a0 tx=0x7f1dc002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417d7ede2633900 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f7f82d39640 1 -- 172.21.15.6:0/3169300242 shutdown_connections 2023-12-19T13:33:13.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f5c97727640 1 -- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c90149430 msgr2=0x7f5c900b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7f5c97727640 1 --2- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c90149430 0x7f5c900b68c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c9014cb80 tx=0x7f5c8c02b8a0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.215+0000 7fe6c648b640 1 Processor -- start 2023-12-19T13:33:13.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 -- 172.21.15.6:0/1519547118 shutdown_connections 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 --2- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c90149430 0x7f5c900b68c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 --2- 172.21.15.6:0/1519547118 >> v2:172.21.15.6:3300/0 conn(0x7f5c9006fa10 0x7f5c90148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 --2- 172.21.15.6:0/1519547118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006a390 0x7f5c9006fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 -- 172.21.15.6:0/1519547118 >> 172.21.15.6:0/1519547118 conn(0x7f5c900bc330 msgr2=0x7f5c900bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f10815d9640 1 -- 172.21.15.6:0/639099623 shutdown_connections 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f1dce7fc640 1 -- 172.21.15.6:0/23103159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc002f810 con 0x7f1dd00b7a40 2023-12-19T13:33:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f1dce7fc640 1 -- 172.21.15.6:0/23103159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc002f970 con 0x7f1dd00b7a40 2023-12-19T13:33:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f1dce7fc640 1 -- 172.21.15.6:0/23103159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc002fd00 con 0x7f1dd00b7a40 2023-12-19T13:33:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4d03c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c80705d0 0x7fb4c80bb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 -- 172.21.15.6:0/1519547118 shutdown_connections 2023-12-19T13:33:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4d03c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4c80b3900 0x7fb4c81e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5a3359e640 1 -- 172.21.15.6:0/3784049783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 msgr2=0x7f5a3414ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5a3359e640 1 --2- 172.21.15.6:0/3784049783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 0x7f5a3414ed70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a340ba7d0 tx=0x7f5a2402b860 comp rx=0 tx=0).stop 2023-12-19T13:33:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4d03c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c814efb0 0x7fb4c8148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4ce165640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c80705d0 0x7fb4c80bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4ce165640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c80705d0 0x7fb4c80bb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34816/0 (socket says 172.21.15.6:34816) 2023-12-19T13:33:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4ce165640 1 -- 172.21.15.6:0/3876584825 learned_addr learned my addr 172.21.15.6:0/3876584825 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4cd964640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4c80b3900 0x7fb4c81e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80bbb50 con 0x7fb4c80b3900 2023-12-19T13:33:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f7f82d39640 1 -- 172.21.15.6:0/3169300242 wait complete. 2023-12-19T13:33:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c81e79c0 con 0x7fb4c814efb0 2023-12-19T13:33:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c81e7100 con 0x7fb4c80705d0 2023-12-19T13:33:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fb4ce966640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c814efb0 0x7fb4c8148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7fe6c648b640 1 -- start start 2023-12-19T13:33:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6c648b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c006a500 0x7fe6c0147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fb4ce966640 1 -- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c80705d0 msgr2=0x7fb4c80bb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fb4ce966640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4c80705d0 0x7fb4c80bb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fb4ce966640 1 -- 172.21.15.6:0/3876584825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4c80b3900 msgr2=0x7fb4c81e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fb4ce966640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4c80b3900 0x7fb4c81e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fb4ce966640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009400 con 0x7fb4c814efb0 2023-12-19T13:33:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c006a500 0x7fe6c0147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c006a500 0x7fe6c0147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34454/0 (socket says 172.21.15.6:34454) 2023-12-19T13:33:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6bffff640 1 -- 172.21.15.6:0/989972471 learned_addr learned my addr 172.21.15.6:0/989972471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6c648b640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c0149140 0x7fe6c0145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f7f82d39640 1 Processor -- start 2023-12-19T13:33:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6c648b640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6c01e4340 0x7fe6c01e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c0148050 con 0x7fe6c006a500 2023-12-19T13:33:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f5c97727640 1 -- 172.21.15.6:0/1519547118 wait complete. 2023-12-19T13:33:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c01e4d30 con 0x7fe6c01e4340 2023-12-19T13:33:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c01451f0 con 0x7fe6c0149140 2023-12-19T13:33:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5a3359e640 1 -- 172.21.15.6:0/3784049783 shutdown_connections 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5a3359e640 1 --2- 172.21.15.6:0/3784049783 >> v2:172.21.15.89:3300/0 conn(0x7f5a340b8090 0x7f5a340b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5a3359e640 1 --2- 172.21.15.6:0/3784049783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 0x7f5a3414ed70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5a3359e640 1 -- 172.21.15.6:0/3784049783 >> 172.21.15.6:0/3784049783 conn(0x7f5a340b6c60 msgr2=0x7f5a34071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f97f2bd2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f97f2bd2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f97f2bd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec14a1e0 0x7f97ec143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7fb4ce966640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c814efb0 0x7fb4c8148a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400c3f0 tx=0x7fb4c400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f97f2bd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec089d10 con 0x7f97ec14a1e0 2023-12-19T13:33:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f97f2bd2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec146730 con 0x7f97ec070290 2023-12-19T13:33:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f97f2bd2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec148760 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5a3359e640 1 -- 172.21.15.6:0/3784049783 shutdown_connections 2023-12-19T13:33:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5c97727640 1 Processor -- start 2023-12-19T13:33:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f5a3359e640 1 -- 172.21.15.6:0/3784049783 wait complete. 2023-12-19T13:33:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.216+0000 7f10815d9640 1 -- 172.21.15.6:0/639099623 wait complete. 2023-12-19T13:33:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7f10815d9640 1 Processor -- start 2023-12-19T13:33:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f1dd59a4640 1 -- 172.21.15.6:0/23103159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b7a40 msgr2=0x7f1dd00b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f1dd59a4640 1 --2- 172.21.15.6:0/23103159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b7a40 0x7f1dd00b83f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097a0 tx=0x7f1dc002b9f0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f1dd59a4640 1 -- 172.21.15.6:0/23103159 shutdown_connections 2023-12-19T13:33:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f1dd59a4640 1 --2- 172.21.15.6:0/23103159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b7a40 0x7f1dd00b83f0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097a0 tx=0x7f1dc002b9f0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f1dd59a4640 1 -- 172.21.15.6:0/23103159 >> 172.21.15.6:0/23103159 conn(0x7f1dd00c0390 msgr2=0x7f1dd00c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bf7fe640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c0149140 0x7fe6c0145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6c4a28640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6c01e4340 0x7fe6c01e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.217+0000 7f7f82d39640 1 -- start start 2023-12-19T13:33:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7f97f096e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40052d0 con 0x7fb4c814efb0 2023-12-19T13:33:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c4005450 con 0x7fb4c814efb0 2023-12-19T13:33:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4003830 con 0x7fb4c814efb0 2023-12-19T13:33:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c81e7370 con 0x7fb4c814efb0 2023-12-19T13:33:13.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bffff640 1 -- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c0149140 msgr2=0x7fe6c0145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bffff640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6c0149140 0x7fe6c0145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bffff640 1 -- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6c01e4340 msgr2=0x7fe6c01e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c81dab40 con 0x7fb4c814efb0 2023-12-19T13:33:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bffff640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6c01e4340 0x7fe6c01e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7f5c97727640 1 -- start start 2023-12-19T13:33:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bffff640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009b30 con 0x7fe6c006a500 2023-12-19T13:33:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6c4a28640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6c01e4340 0x7fe6c01e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7f97ebfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7f97ebfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34834/0 (socket says 172.21.15.6:34834) 2023-12-19T13:33:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7f97ebfff640 1 -- 172.21.15.6:0/1897417953 learned_addr learned my addr 172.21.15.6:0/1897417953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5c97727640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006a390 0x7f5c90147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f82d39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c070290 0x7f7f7c12afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f82d39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 0x7f7f7c132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5c97727640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006fa10 0x7f5c901e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.218+0000 7fe6bffff640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c006a500 0x7fe6c0147b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6b802c4d0 tx=0x7fe6b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f80ad5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c070290 0x7f7f7c12afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f80ad5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c070290 0x7f7f7c12afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:39980/0 (socket says 172.21.15.6:39980) 2023-12-19T13:33:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5c97727640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c90149430 0x7f5c90149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f80ad5640 1 -- 172.21.15.6:0/2100230710 learned_addr learned my addr 172.21.15.6:0/2100230710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b803e450 con 0x7fe6c006a500 2023-12-19T13:33:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f1dd59a4640 1 -- 172.21.15.6:0/23103159 shutdown_connections 2023-12-19T13:33:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f82d39640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c14a1e0 0x7f7f7c1e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1325c0 con 0x7f7f7c0b5bf0 2023-12-19T13:33:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c12e430 con 0x7f7f7c070290 2023-12-19T13:33:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c136a90 con 0x7f7f7c14a1e0 2023-12-19T13:33:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5a3359e640 1 Processor -- start 2023-12-19T13:33:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f97f116f640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec14a1e0 0x7f97ec143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5a3359e640 1 -- start start 2023-12-19T13:33:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c01439f0 con 0x7fe6c006a500 2023-12-19T13:33:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f97ebfff640 1 -- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 msgr2=0x7f97ec142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c0143fb0 con 0x7fe6c006a500 2023-12-19T13:33:13.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f97ebfff640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b803e5b0 con 0x7fe6c006a500 2023-12-19T13:33:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4c8152550 con 0x7fb4c814efb0 2023-12-19T13:33:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f97ebfff640 1 -- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec14a1e0 msgr2=0x7f97ec143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f97ebfff640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec14a1e0 0x7f97ec143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f97ebfff640 1 -- 172.21.15.6:0/1897417953 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009b30 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c97727640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90148330 con 0x7f5c90149430 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c97727640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9014fdd0 con 0x7f5c9006a390 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c97727640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9014b730 con 0x7f5c9006fa10 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c95cc4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c90149430 0x7f5c90149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c95cc4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c90149430 0x7f5c90149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34480/0 (socket says 172.21.15.6:34480) 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c95cc4640 1 -- 172.21.15.6:0/329192587 learned_addr learned my addr 172.21.15.6:0/329192587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f97f096e640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec070290 0x7f97ec142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5c954c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006a390 0x7f5c90147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f5c94cc2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006fa10 0x7f5c901e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f7f7bfff640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 0x7f7f7c132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f7f812d6640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c14a1e0 0x7f7f7c1e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f7f80ad5640 1 -- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c14a1e0 msgr2=0x7f7f7c1e53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f7f80ad5640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c14a1e0 0x7f7f7c1e53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f7f80ad5640 1 -- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 msgr2=0x7f7f7c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f7f80ad5640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0b5bf0 0x7f7f7c132080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f7f80ad5640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74009b30 con 0x7f7f7c070290 2023-12-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f97ebfff640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec145b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c7f0 tx=0x7f97d800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5a3359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 0x7f5a3414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5a3359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a340b8090 0x7f5a341445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c94cc2640 1 -- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006a390 msgr2=0x7f5c90147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c94cc2640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006a390 0x7f5c90147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c94cc2640 1 -- 172.21.15.6:0/329192587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c90149430 msgr2=0x7f5c90149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c94cc2640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c90149430 0x7f5c90149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7f5c94cc2640 1 -- 172.21.15.6:0/329192587 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c0094d0 con 0x7f5c9006fa10 2023-12-19T13:33:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.220+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb4c4003990 con 0x7fb4c814efb0 2023-12-19T13:33:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a3359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a34148b10 0x7f5a34144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b803e960 con 0x7fe6c006a500 2023-12-19T13:33:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5c94cc2640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006fa10 0x7f5c901e29e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c88007e60 tx=0x7f5c8800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a3359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3414bf50 con 0x7f5a340b7860 2023-12-19T13:33:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a340b8090 0x7f5a341445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a340b8090 0x7f5a341445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40000/0 (socket says 172.21.15.6:40000) 2023-12-19T13:33:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 -- 172.21.15.6:0/325731898 learned_addr learned my addr 172.21.15.6:0/325731898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.219+0000 7f1dd59a4640 1 -- 172.21.15.6:0/23103159 wait complete. 2023-12-19T13:33:13.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a3359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3414e210 con 0x7f5a340b8090 2023-12-19T13:33:13.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a3359e640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3414a010 con 0x7f5a34148b10 2023-12-19T13:33:13.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a32d9d640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a34148b10 0x7f5a34144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f1dd59a4640 1 Processor -- start 2023-12-19T13:33:13.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f7f80ad5640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c070290 0x7f7f7c12afb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f74036040 tx=0x7f7f74004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88014620 con 0x7f5c9006fa10 2023-12-19T13:33:13.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8007a30 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9014c270 con 0x7f5c9006fa10 2023-12-19T13:33:13.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7fb4beffd640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb4ac06a530 0x7fb4ac06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8800ee90 con 0x7f5c9006fa10 2023-12-19T13:33:13.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880149a0 con 0x7f5c9006fa10 2023-12-19T13:33:13.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74034e60 con 0x7f7f7c070290 2023-12-19T13:33:13.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9014e080 con 0x7f5c9006fa10 2023-12-19T13:33:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7fb4ce165640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb4ac06a530 0x7fb4ac06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4c4087dd0 con 0x7fb4c814efb0 2023-12-19T13:33:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6a0000fc0 con 0x7fe6c006a500 2023-12-19T13:33:13.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8007b90 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 -- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a34148b10 msgr2=0x7f5a34144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a34148b10 0x7f5a34144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 -- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 msgr2=0x7f5a3414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a340b7860 0x7f5a3414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f5a31d9b640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009a70 con 0x7f5a340b8090 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0899a0 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec147750 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7fb4beffd640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7fb4ac072740 0x7fb4ac074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800ce40 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.221+0000 7f1dd59a4640 1 -- start start 2023-12-19T13:33:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f1dd59a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00bad10 0x7f1dd0146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f1dd59a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd01410f0 0x7f1dd0147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7fb4ce165640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb4ac06a530 0x7fb4ac06c9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4b802ba50 tx=0x7fb4b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4ac075210 con 0x7fb4ac072740 2023-12-19T13:33:13.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4c408a3f0 con 0x7fb4c814efb0 2023-12-19T13:33:13.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f1dd59a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd01490f0 0x7f1dd0149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f10815d9640 1 -- start start 2023-12-19T13:33:13.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f5a31d9b640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a340b8090 0x7f5a341445b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c780 tx=0x7f5a2800cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f1dc7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd01410f0 0x7f1dd0147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f1dc7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd01410f0 0x7f1dd0147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34866/0 (socket says 172.21.15.6:34866) 2023-12-19T13:33:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00bad10 0x7f1dd0146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00bad10 0x7f1dd0146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34506/0 (socket says 172.21.15.6:34506) 2023-12-19T13:33:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe6b803eac0 con 0x7fe6c006a500 2023-12-19T13:33:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dc7fff640 1 -- 172.21.15.6:0/2837778465 learned_addr learned my addr 172.21.15.6:0/2837778465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7403e660 con 0x7f7f7c070290 2023-12-19T13:33:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dcf7fe640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd01490f0 0x7f1dd0149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dd59a4640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd01470d0 con 0x7f1dd00bad10 2023-12-19T13:33:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dd59a4640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0149ac0 con 0x7f1dd01490f0 2023-12-19T13:33:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f1dd59a4640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0145590 con 0x7f1dd01410f0 2023-12-19T13:33:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.222+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7403e9f0 con 0x7f7f7c070290 2023-12-19T13:33:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c137dc0 con 0x7f7f7c070290 2023-12-19T13:33:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c1e4ec0 con 0x7f7f7c070290 2023-12-19T13:33:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c90070600 con 0x7f5c9006fa10 2023-12-19T13:33:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7fb4cd964640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7fb4ac072740 0x7fb4ac074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97cc000fc0 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7fe6bcff9640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe6ac06a530 0x7fe6ac06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dc7fff640 1 -- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd01490f0 msgr2=0x7f1dd0149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dc7fff640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd01490f0 0x7f1dd0149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dc7fff640 1 -- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00bad10 msgr2=0x7f1dd0146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dc7fff640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00bad10 0x7f1dd0146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dc7fff640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009400 con 0x7f1dd01410f0 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dcf7fe640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd01490f0 0x7f1dd0149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28005ad0 con 0x7f5a340b8090 2023-12-19T13:33:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28005c30 con 0x7f5a340b8090 2023-12-19T13:33:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28007070 con 0x7f5a340b8090 2023-12-19T13:33:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7fe6bf7fe640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe6ac06a530 0x7fe6ac06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6b80ab510 con 0x7fe6c006a500 2023-12-19T13:33:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c88014b00 con 0x7f5c9006fa10 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f10815d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f107c14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f10815d9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f107c0b56b0 0x7f107c1ec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f10815d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f107c0b71e0 0x7f107c1e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f10815d9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c14dca0 con 0x7f107c0b56b0 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f10815d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c1ec600 con 0x7f1064005180 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f10815d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0b5220 con 0x7f107c0b71e0 2023-12-19T13:33:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f107bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f107c0b71e0 0x7f107c1e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f107bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f107c0b71e0 0x7f107c1e5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34874/0 (socket says 172.21.15.6:34874) 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f107bfff640 1 -- 172.21.15.6:0/4108206360 learned_addr learned my addr 172.21.15.6:0/4108206360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.223+0000 7f107a7fc640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f107c0b56b0 0x7f107c1ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f107a7fc640 1 -- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f107c0b71e0 msgr2=0x7f107c1e5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f107a7fc640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f107c0b71e0 0x7f107c1e5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f107a7fc640 1 -- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 msgr2=0x7f107c14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f107affd640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f107c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5c85ffb640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7406a500 0x7f5c7406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dceffd640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00bad10 0x7f1dd0146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dc7fff640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd01410f0 0x7f1dd0147a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c460 tx=0x7f1db800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7fe6bf7fe640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe6ac06a530 0x7fe6ac06c9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0148270 tx=0x7fe6b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7fe6bcff9640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fe6ac0725e0 0x7fe6ac074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c880891c0 con 0x7f5c9006fa10 2023-12-19T13:33:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db80052d0 con 0x7f1dd01410f0 2023-12-19T13:33:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8005430 con 0x7f1dd01410f0 2023-12-19T13:33:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8012830 con 0x7f1dd01410f0 2023-12-19T13:33:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6ac0750b0 con 0x7fe6ac0725e0 2023-12-19T13:33:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f1dd59a4640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd0148610 con 0x7f1dd01410f0 2023-12-19T13:33:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6b80adb30 con 0x7fe6c006a500 2023-12-19T13:33:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f1dd59a4640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd0148bd0 con 0x7f1dd01410f0 2023-12-19T13:33:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5c85ffb640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f5c74072720 0x7f5c74074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 --> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c740751f0 con 0x7f5c74072720 2023-12-19T13:33:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5c954c3640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7406a500 0x7f5c7406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c8808b720 con 0x7f5c9006fa10 2023-12-19T13:33:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f107a7fc640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1064005180 0x7f107c14d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f107a7fc640 1 -- 172.21.15.6:0/4108206360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c146470 con 0x7f107c0b56b0 2023-12-19T13:33:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f107bfff640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f107c0b71e0 0x7f107c1e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f97d801a450 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7fe6c4a28640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fe6ac0725e0 0x7fe6ac074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f5c95cc4640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f5c74072720 0x7f5c74074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f107a7fc640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f107c0b56b0 0x7f107c1ec0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1074007770 tx=0x7f107400f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7fb4cd964640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7fb4ac072740 0x7fb4ac074b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5a3359e640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a24009400 con 0x7f5a340b8090 2023-12-19T13:33:13.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f5a3359e640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a34149ca0 con 0x7f5a340b8090 2023-12-19T13:33:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f97e97fa640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f97d006a460 0x7f97d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7fe6c4a28640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fe6ac0725e0 0x7fe6ac074a00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400fc10 con 0x7f107c0b56b0 2023-12-19T13:33:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c0b4bd0 con 0x7f107c0b56b0 2023-12-19T13:33:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.225+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c148390 con 0x7f107c0b56b0 2023-12-19T13:33:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f97f096e640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f97d006a460 0x7f97d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f5c95cc4640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f5c74072720 0x7f5c74074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97d8058070 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107400fd70 con 0x7f107c0b56b0 2023-12-19T13:33:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400fee0 con 0x7f107c0b56b0 2023-12-19T13:33:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f97e97fa640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f97d0073210 0x7f97d00756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f5a3359e640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a340b8a40 con 0x7f5a340b8090 2023-12-19T13:33:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== osd.6 v2:172.21.15.89:6816/89547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb4ac075210 con 0x7fb4ac072740 2023-12-19T13:33:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 --> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97d0075d80 con 0x7f97d0073210 2023-12-19T13:33:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97d8004660 con 0x7f97ec0b5bf0 2023-12-19T13:33:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.224+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f7c06fa70 con 0x7f7f7c070290 2023-12-19T13:33:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f7403eb50 con 0x7f7f7c070290 2023-12-19T13:33:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f7f797fa640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7f6806a530 0x7f7f6806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f740abaf0 con 0x7f7f7c070290 2023-12-19T13:33:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f7bfff640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7f6806a530 0x7f7f6806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f5c954c3640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7406a500 0x7f5c7406c9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009ac0 tx=0x7f5c80009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== osd.5 v2:172.21.15.89:6800/89536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe6ac0750b0 con 0x7fe6ac0725e0 2023-12-19T13:33:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== osd.4 v2:172.21.15.89:6824/89538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5c740751f0 con 0x7f5c74072720 2023-12-19T13:33:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f105c000fc0 con 0x7f107c0b56b0 2023-12-19T13:33:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f797fa640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7f68072750 0x7f7f68074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f68075220 con 0x7f7f68072750 2023-12-19T13:33:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f740abea0 con 0x7f7f7c070290 2023-12-19T13:33:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f812d6640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7f68072750 0x7f7f68074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f97f096e640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f97d006a460 0x7f97d006c920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97e0006fd0 tx=0x7f97e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.226+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1dd00b7e20 con 0x7f1dd01410f0 2023-12-19T13:33:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.227+0000 7f7f812d6640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7f68072750 0x7f7f68074b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.228+0000 7f97f116f640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f97d0073210 0x7f97d00756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.228+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f10740062b0 con 0x7f107c0b56b0 2023-12-19T13:33:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.228+0000 7f97f116f640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f97d0073210 0x7f97d00756b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.228+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1db8012990 con 0x7f1dd01410f0 2023-12-19T13:33:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.228+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a280071d0 con 0x7f5a340b8090 2023-12-19T13:33:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f5a22ffd640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a1406a500 0x7f5a1406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f1dccff9640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1db006a430 0x7f1db006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f10637fe640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f106806a500 0x7f106806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1074088d50 con 0x7f107c0b56b0 2023-12-19T13:33:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f10637fe640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f10680726a0 0x7f1068074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 --> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1068075170 con 0x7f10680726a0 2023-12-19T13:33:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1db8088820 con 0x7f1dd01410f0 2023-12-19T13:33:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== osd.0 v2:172.21.15.6:6808/89548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7f68075220 con 0x7f7f68072750 2023-12-19T13:33:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f1dccff9640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1db0072650 0x7f1db0074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1db0075120 con 0x7f1db0072650 2023-12-19T13:33:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1db8088bd0 con 0x7f1dd01410f0 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== osd.2 v2:172.21.15.6:6800/89547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f97d0075d80 con 0x7f97d0073210 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a28089070 con 0x7f5a340b8090 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f5a3259c640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a1406a500 0x7f5a1406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f5a22ffd640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7f5a14072720 0x7f5a14074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a140751f0 con 0x7f5a14072720 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.229+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a28089420 con 0x7f5a340b8090 2023-12-19T13:33:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f107bfff640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f10680726a0 0x7f1068074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f7f7bfff640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7f6806a530 0x7f7f6806c9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c14a070 tx=0x7f7f70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f5a32d9d640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7f5a14072720 0x7f5a14074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f5a3259c640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a1406a500 0x7f5a1406c9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a24035000 tx=0x7f5a24030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f1dcf7fe640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1db0072650 0x7f1db0074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f1dceffd640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1db006a430 0x7f1db006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f1dcf7fe640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1db0072650 0x7f1db0074a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f5a32d9d640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7f5a14072720 0x7f5a14074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f1dceffd640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1db006a430 0x7f1db006c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0036000 tx=0x7f1dc0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f107affd640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f106806a500 0x7f106806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10740543b0 con 0x7f107c0b56b0 2023-12-19T13:33:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.230+0000 7f107affd640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f106806a500 0x7f106806c9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f106c006fd0 tx=0x7f106c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.231+0000 7f107bfff640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f10680726a0 0x7f1068074ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.231+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== osd.1 v2:172.21.15.6:6816/89549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1db0075120 con 0x7f1db0072650 2023-12-19T13:33:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.232+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== osd.3 v2:172.21.15.6:6821/89558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5a140751f0 con 0x7f5a14072720 2023-12-19T13:33:13.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.233+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== osd.7 v2:172.21.15.89:6808/89537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1068075170 con 0x7f10680726a0 2023-12-19T13:33:13.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.257+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 --> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb4c80b9560 con 0x7fb4ac072740 2023-12-19T13:33:13.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.257+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 --> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6a0002cb0 con 0x7fe6ac0725e0 2023-12-19T13:33:13.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4beffd640 1 -- 172.21.15.6:0/3876584825 <== osd.6 v2:172.21.15.89:6816/89547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb4c0001f00 con 0x7fb4ac072740 2023-12-19T13:33:13.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fe6bcff9640 1 -- 172.21.15.6:0/989972471 <== osd.5 v2:172.21.15.89:6800/89536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6a0002cb0 con 0x7fe6ac0725e0 2023-12-19T13:33:13.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7fb4ac072740 msgr2=0x7fb4ac074b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4d03c9640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7fb4ac072740 0x7fb4ac074b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb4ac06a530 msgr2=0x7fb4ac06c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4d03c9640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb4ac06a530 0x7fb4ac06c9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4b802ba50 tx=0x7fb4b8008030 comp rx=0 tx=0).stop 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c814efb0 msgr2=0x7fb4c8148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.258+0000 7fb4d03c9640 1 --2- 172.21.15.6:0/3876584825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4c814efb0 0x7fb4c8148a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400c3f0 tx=0x7fb4c400c8b0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fb4ce966640 1 -- 172.21.15.6:0/3876584825 reap_dead start 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 shutdown_connections 2023-12-19T13:33:13.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 >> 172.21.15.6:0/3876584825 conn(0x7fb4c806ae10 msgr2=0x7fb4c80710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fe6ac0725e0 msgr2=0x7fe6ac074a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 --> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c9014ff40 con 0x7f5c74072720 2023-12-19T13:33:13.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c648b640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fe6ac0725e0 0x7fe6ac074a00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe6ac06a530 msgr2=0x7fe6ac06c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c648b640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe6ac06a530 0x7fe6ac06c9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0148270 tx=0x7fe6b0009040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 shutdown_connections 2023-12-19T13:33:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c006a500 msgr2=0x7fe6c0147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fb4d03c9640 1 -- 172.21.15.6:0/3876584825 wait complete. 2023-12-19T13:33:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c648b640 1 --2- 172.21.15.6:0/989972471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c006a500 0x7fe6c0147b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6b802c4d0 tx=0x7fe6b8004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7fe6c4a28640 1 -- 172.21.15.6:0/989972471 reap_dead start 2023-12-19T13:33:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.259+0000 7f5c85ffb640 1 -- 172.21.15.6:0/329192587 <== osd.4 v2:172.21.15.89:6824/89538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5c9014ff40 con 0x7f5c74072720 2023-12-19T13:33:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.260+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 shutdown_connections 2023-12-19T13:33:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.260+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 >> 172.21.15.6:0/989972471 conn(0x7fe6c00bc330 msgr2=0x7fe6c0070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.260+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 shutdown_connections 2023-12-19T13:33:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.260+0000 7fe6c648b640 1 -- 172.21.15.6:0/989972471 wait complete. 2023-12-19T13:33:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 --> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f7c06f790 con 0x7f7f68072750 2023-12-19T13:33:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f5c74072720 msgr2=0x7f5c74074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f5c74072720 0x7f5c74074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7406a500 msgr2=0x7f5c7406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7406a500 0x7f5c7406c9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009ac0 tx=0x7f5c80009190 comp rx=0 tx=0).stop 2023-12-19T13:33:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006fa10 msgr2=0x7f5c901e29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 --2- 172.21.15.6:0/329192587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006fa10 0x7f5c901e29e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c88007e60 tx=0x7f5c8800e4b0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c95cc4640 1 -- 172.21.15.6:0/329192587 reap_dead start 2023-12-19T13:33:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 shutdown_connections 2023-12-19T13:33:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 >> 172.21.15.6:0/329192587 conn(0x7f5c900bc330 msgr2=0x7f5c900b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 shutdown_connections 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.261+0000 7f7f797fa640 1 -- 172.21.15.6:0/2100230710 <== osd.0 v2:172.21.15.6:6808/89548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f6c00a2f0 con 0x7f7f68072750 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7f68072750 msgr2=0x7f7f68074b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7f68072750 0x7f7f68074b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f5c97727640 1 -- 172.21.15.6:0/329192587 wait complete. 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7f6806a530 msgr2=0x7f7f6806c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7f6806a530 0x7f7f6806c9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c14a070 tx=0x7f7f70009040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c070290 msgr2=0x7f7f7c12afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 --2- 172.21.15.6:0/2100230710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c070290 0x7f7f7c12afb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f74036040 tx=0x7f7f74004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f812d6640 1 -- 172.21.15.6:0/2100230710 reap_dead start 2023-12-19T13:33:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 --> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1dd00bbeb0 con 0x7f1db0072650 2023-12-19T13:33:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 --> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97cc002cb0 con 0x7f97d0073210 2023-12-19T13:33:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 shutdown_connections 2023-12-19T13:33:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 >> 172.21.15.6:0/2100230710 conn(0x7f7f7c0bc120 msgr2=0x7f7f7c069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 shutdown_connections 2023-12-19T13:33:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.262+0000 7f7f82d39640 1 -- 172.21.15.6:0/2100230710 wait complete. 2023-12-19T13:33:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.263+0000 7f1dccff9640 1 -- 172.21.15.6:0/2837778465 <== osd.1 v2:172.21.15.6:6816/89549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1dc8002050 con 0x7f1db0072650 2023-12-19T13:33:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.263+0000 7f97e97fa640 1 -- 172.21.15.6:0/1897417953 <== osd.2 v2:172.21.15.6:6800/89547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f97cc002cb0 con 0x7f97d0073210 2023-12-19T13:33:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.263+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 --> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f105c002ca0 con 0x7f10680726a0 2023-12-19T13:33:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.263+0000 7f5a3359e640 1 -- 172.21.15.6:0/325731898 --> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a340b7c40 con 0x7f5a14072720 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.263+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f97d0073210 msgr2=0x7f97d00756b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.263+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f97d0073210 0x7f97d00756b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f97d006a460 msgr2=0x7f97d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f97d006a460 0x7f97d006c920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97e0006fd0 tx=0x7f97e0008040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 msgr2=0x7f97ec145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f2bd2640 1 --2- 172.21.15.6:0/1897417953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec0b5bf0 0x7f97ec145b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c7f0 tx=0x7f97d800cbf0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1db0072650 msgr2=0x7f1db0074a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1db0072650 0x7f1db0074a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1db006a430 msgr2=0x7f1db006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1db006a430 0x7f1db006c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0036000 tx=0x7f1dc0008030 comp rx=0 tx=0).stop 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd01410f0 msgr2=0x7f1dd0147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 --2- 172.21.15.6:0/2837778465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd01410f0 0x7f1dd0147a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c460 tx=0x7f1db800c920 comp rx=0 tx=0).stop 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dcf7fe640 1 -- 172.21.15.6:0/2837778465 reap_dead start 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 shutdown_connections 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 >> 172.21.15.6:0/2837778465 conn(0x7f1dd00c0390 msgr2=0x7f1dd013b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f116f640 1 -- 172.21.15.6:0/1897417953 reap_dead start 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 shutdown_connections 2023-12-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 >> 172.21.15.6:0/1897417953 conn(0x7f97ec0bc120 msgr2=0x7f97ec069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f5a22ffd640 1 -- 172.21.15.6:0/325731898 <== osd.3 v2:172.21.15.6:6821/89558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a2c00f040 con 0x7f5a14072720 2023-12-19T13:33:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f10637fe640 1 -- 172.21.15.6:0/4108206360 <== osd.7 v2:172.21.15.89:6808/89537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f105c002ca0 con 0x7f10680726a0 2023-12-19T13:33:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 shutdown_connections 2023-12-19T13:33:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f1dc5ffb640 1 -- 172.21.15.6:0/2837778465 wait complete. 2023-12-19T13:33:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 shutdown_connections 2023-12-19T13:33:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.264+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f10680726a0 msgr2=0x7f1068074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f10680726a0 0x7f1068074ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f106806a500 msgr2=0x7f106806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f106806a500 0x7f106806c9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f106c006fd0 tx=0x7f106c008040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7f5a14072720 msgr2=0x7f5a14074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a20ff9640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7f5a14072720 0x7f5a14074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f107c0b56b0 msgr2=0x7f107c1ec0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 --2- 172.21.15.6:0/4108206360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f107c0b56b0 0x7f107c1ec0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1074007770 tx=0x7f107400f1d0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f107bfff640 1 -- 172.21.15.6:0/4108206360 reap_dead start 2023-12-19T13:33:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a1406a500 msgr2=0x7f5a1406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a20ff9640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a1406a500 0x7f5a1406c9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a24035000 tx=0x7f5a24030000 comp rx=0 tx=0).stop 2023-12-19T13:33:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a340b8090 msgr2=0x7f5a341445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a20ff9640 1 --2- 172.21.15.6:0/325731898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a340b8090 0x7f5a341445b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c780 tx=0x7f5a2800cb80 comp rx=0 tx=0).stop 2023-12-19T13:33:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f5a32d9d640 1 -- 172.21.15.6:0/325731898 reap_dead start 2023-12-19T13:33:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f97f2bd2640 1 -- 172.21.15.6:0/1897417953 wait complete. 2023-12-19T13:33:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 shutdown_connections 2023-12-19T13:33:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 >> 172.21.15.6:0/4108206360 conn(0x7f107c0bd870 msgr2=0x7f107c0bdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 shutdown_connections 2023-12-19T13:33:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.265+0000 7f10815d9640 1 -- 172.21.15.6:0/4108206360 wait complete. 2023-12-19T13:33:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.266+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 shutdown_connections 2023-12-19T13:33:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.266+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 >> 172.21.15.6:0/325731898 conn(0x7f5a340b6c60 msgr2=0x7f5a3414f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.266+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 shutdown_connections 2023-12-19T13:33:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.266+0000 7f5a20ff9640 1 -- 172.21.15.6:0/325731898 wait complete. 2023-12-19T13:33:13.327 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:13.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T13:33:13.329 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-12-19T13:33:13.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T13:33:13.330 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:13.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T13:33:13.331 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:13.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T13:33:13.331 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:13.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T13:33:13.332 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:13.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T13:33:13.333 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-12-19T13:33:13.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T13:33:13.335 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:13.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T13:33:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7fb8cf285640 1 Processor -- start 2023-12-19T13:33:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7fb0fa71b640 1 Processor -- start 2023-12-19T13:33:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7fb0fa71b640 1 -- start start 2023-12-19T13:33:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7f604ba7d640 1 Processor -- start 2023-12-19T13:33:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7f604ba7d640 1 -- start start 2023-12-19T13:33:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f604ba7d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60440be160 0x7f60440b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f604ba7d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f604414be90 0x7f60440b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f604ba7d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604414c2c0 con 0x7f60440b9540 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f604ba7d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60440b6340 con 0x7f604414be90 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f604ba7d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60440ba4b0 con 0x7f60440be160 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f4d2ab92640 1 Processor -- start 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb0fa71b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 0x7fb0f406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb0fa71b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0f40b7ce0 0x7fb0f406b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb0fa71b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f40b2c00 con 0x7fb0f406bc40 2023-12-19T13:33:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb0fa71b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f406b8b0 con 0x7fb0f40b7ce0 2023-12-19T13:33:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb0fa71b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4149540 con 0x7fb0f40b7900 2023-12-19T13:33:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7fd4a4d4e640 1 Processor -- start 2023-12-19T13:33:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f576e35c640 1 Processor -- start 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f6049018640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f60440b9540 0x7f60441427d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59724/0 (socket says 172.21.15.6:59724) 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f6049018640 1 -- 172.21.15.6:0/884139269 learned_addr learned my addr 172.21.15.6:0/884139269 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7fb8cf285640 1 -- start start 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb8cf285640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8c80b7d30 0x7fb8c80716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb8cf285640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8c8149320 0x7fb8c806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb8cf285640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c806f2c0 con 0x7fb8c80b8850 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb8cf285640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c806ec70 con 0x7fb8c80b7d30 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fb8cf285640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c806ef50 con 0x7fb8c8149320 2023-12-19T13:33:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fb0f8cb8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0f40b7ce0 0x7fb0f406b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f604a01a640 1 --2- 172.21.15.6:0/884139269 >> v2:172.21.15.6:3300/0 conn(0x7f604414be90 0x7f60440b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fb8ce283640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8c80b7d30 0x7fb8c80716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f6049819640 1 --2- 172.21.15.6:0/884139269 >> v2:172.21.15.89:3300/0 conn(0x7f60440be160 0x7f60440b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fb0f37fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb0f406bc40 0x7fb0f414edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59726/0 (socket says 172.21.15.6:59726) 2023-12-19T13:33:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fb0f37fe640 1 -- 172.21.15.6:0/1077127419 learned_addr learned my addr 172.21.15.6:0/1077127419 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f4d2ab92640 1 -- start start 2023-12-19T13:33:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fb8cda82640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb8c80b8850 0x7fb8c8148c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59732/0 (socket says 172.21.15.6:59732) 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.550+0000 7f885dbdc640 1 Processor -- start 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f885dbdc640 1 -- start start 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885dbdc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 0x7f88580716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885dbdc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f885806fdf0 0x7f8858148a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885dbdc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580b7c10 con 0x7f885806efb0 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885dbdc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580b85b0 con 0x7f885806fdf0 2023-12-19T13:33:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885dbdc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b7ef0 con 0x7f885806caa0 2023-12-19T13:33:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fb8cda82640 1 -- 172.21.15.6:0/2845750903 learned_addr learned my addr 172.21.15.6:0/2845750903 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7f576e35c640 1 -- start start 2023-12-19T13:33:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576e35c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5760008fb0 0x7f57600e0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f6048817640 1 -- 172.21.15.6:0/884139269 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054071667 0 0) 0x7f604414c2c0 con 0x7f60440b9540 2023-12-19T13:33:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576e35c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576003abf0 con 0x7f576003c3c0 2023-12-19T13:33:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576e35c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57600293b0 con 0x7f5760008880 2023-12-19T13:33:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576e35c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5760006db0 con 0x7f5760008fb0 2023-12-19T13:33:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885cbda640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 0x7f88580716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f6048817640 1 -- 172.21.15.6:0/884139269 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003520 con 0x7f60440b9540 2023-12-19T13:33:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885cbda640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 0x7f88580716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34882/0 (socket says 172.21.15.6:34882) 2023-12-19T13:33:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576c8f9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5760008fb0 0x7f57600e0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576c8f9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5760008fb0 0x7f57600e0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40062/0 (socket says 172.21.15.6:40062) 2023-12-19T13:33:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f576c8f9640 1 -- 172.21.15.6:0/3861581592 learned_addr learned my addr 172.21.15.6:0/3861581592 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7f885cbda640 1 -- 172.21.15.6:0/3378356650 learned_addr learned my addr 172.21.15.6:0/3378356650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f6049819640 1 -- 172.21.15.6:0/884139269 >> v2:172.21.15.6:3300/0 conn(0x7f604414be90 msgr2=0x7f60440b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f6049819640 1 --2- 172.21.15.6:0/884139269 >> v2:172.21.15.6:3300/0 conn(0x7f604414be90 0x7f60440b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f6049819640 1 -- 172.21.15.6:0/884139269 >> v1:172.21.15.89:6789/0 conn(0x7f60440b9540 legacy=0x7f60441427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.551+0000 7fd4a4d4e640 1 -- start start 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d2ab92640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d1c007490 0x7f4d1c042b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d2ab92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 0x7f4d1c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d2ab92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d1c0d8c20 0x7f4d1c0d9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d2ab92640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c03ee40 con 0x7f4d1c007490 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d2ab92640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c0d9590 con 0x7f4d1c0d8c20 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d2ab92640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c03f090 con 0x7f4d1c0cf1d0 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f6049819640 1 -- 172.21.15.6:0/884139269 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440b4ab0 con 0x7f60440be160 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb8ce283640 1 -- 172.21.15.6:0/2845750903 >> v2:172.21.15.89:3300/0 conn(0x7fb8c8149320 msgr2=0x7fb8c806f810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb8ce283640 1 --2- 172.21.15.6:0/2845750903 >> v2:172.21.15.89:3300/0 conn(0x7fb8c8149320 0x7fb8c806f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb8cd281640 1 -- 172.21.15.6:0/2845750903 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648909016 0 0) 0x7fb8c806f2c0 con 0x7fb8c80b8850 2023-12-19T13:33:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb8ce283640 1 -- 172.21.15.6:0/2845750903 >> v1:172.21.15.89:6789/0 conn(0x7fb8c80b8850 legacy=0x7fb8c8148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 0x7fb0f406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb8ce283640 1 -- 172.21.15.6:0/2845750903 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80b8110 con 0x7fb8c80b7d30 2023-12-19T13:33:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127224554 0 0) 0x7f57600293b0 con 0x7f5760008880 2023-12-19T13:33:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5758003520 con 0x7f5760008880 2023-12-19T13:33:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d23fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 0x7f4d1c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d23fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 0x7f4d1c0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34886/0 (socket says 172.21.15.6:34886) 2023-12-19T13:33:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d23fff640 1 -- 172.21.15.6:0/2444282843 learned_addr learned my addr 172.21.15.6:0/2444282843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f4d29930640 1 --2- 172.21.15.6:0/2444282843 >> v2:172.21.15.89:3300/0 conn(0x7f4d1c0d8c20 0x7f4d1c0d9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 898896410 0 0) 0x7f5758003520 con 0x7f5760008880 2023-12-19T13:33:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 >> v2:172.21.15.89:3300/0 conn(0x7f5760008fb0 msgr2=0x7f57600e0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535695276 0 0) 0x7fb0f40b2c00 con 0x7fb0f406bc40 2023-12-19T13:33:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fd4a4d4e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4980cf4e0 0x7fd4980cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fd4a4d4e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49803e880 con 0x7fd498007370 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fd4a4d4e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49803ad60 con 0x7fd498006f90 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.552+0000 7fd4a4d4e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980d5d20 con 0x7fd4980cf4e0 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fd49dd9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd498006f90 0x7fd49803a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59754/0 (socket says 172.21.15.6:59754) 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fd49dd9b640 1 -- 172.21.15.6:0/3121923588 learned_addr learned my addr 172.21.15.6:0/3121923588 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fd49e59c640 1 --2- 172.21.15.6:0/3121923588 >> v2:172.21.15.6:3300/0 conn(0x7fd4980cf4e0 0x7fd4980cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167937170 0 0) 0x7fd49803ad60 con 0x7fd498006f90 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a0072f90 con 0x7fd498006f90 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0dc003520 con 0x7fb0f406bc40 2023-12-19T13:33:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f69eefb9640 1 Processor -- start 2023-12-19T13:33:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 --2- 172.21.15.6:0/3861581592 >> v2:172.21.15.89:3300/0 conn(0x7f5760008fb0 0x7f57600e0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 >> v1:172.21.15.6:6789/0 conn(0x7f576003c3c0 legacy=0x7f57600cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760029690 con 0x7f5760008880 2023-12-19T13:33:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f5754001650 con 0x7f5760008880 2023-12-19T13:33:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f4d2892e640 1 --2- 172.21.15.6:0/2444282843 >> v2:172.21.15.6:3300/0 conn(0x7f4d1c007490 0x7f4d1c042b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3546745360 0 0) 0x7fb0dc003520 con 0x7fb0f406bc40 2023-12-19T13:33:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 msgr2=0x7fb0f406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 0x7fb0f406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 >> v2:172.21.15.6:3300/0 conn(0x7fb0f40b7ce0 msgr2=0x7fb0f406b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 --2- 172.21.15.6:0/1077127419 >> v2:172.21.15.6:3300/0 conn(0x7fb0f40b7ce0 0x7fb0f406b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4071ae0 con 0x7fb0f406bc40 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fb0e8001670 con 0x7fb0f406bc40 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 >> v1:172.21.15.89:6789/0 conn(0x7fb0f406bc40 legacy=0x7fb0f414edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f885cbda640 1 -- 172.21.15.6:0/3378356650 >> v2:172.21.15.6:3300/0 conn(0x7f885806fdf0 msgr2=0x7f8858148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0dc003970 0x7fb0dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f885cbda640 1 --2- 172.21.15.6:0/3378356650 >> v2:172.21.15.6:3300/0 conn(0x7f885806fdf0 0x7f8858148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f885cbda640 1 -- 172.21.15.6:0/3378356650 >> v1:172.21.15.6:6789/0 conn(0x7f885806efb0 legacy=0x7f885806f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f885cbda640 1 -- 172.21.15.6:0/3378356650 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580b81d0 con 0x7f885806caa0 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 >> v1:172.21.15.89:6789/0 conn(0x7f5760008880 legacy=0x7f5760006f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc0047c0 0x7fb0dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 0x7fb0dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f406b8b0 con 0x7fb0dc003970 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4149540 con 0x7fb0dc0047c0 2023-12-19T13:33:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc00b980 con 0x7fb0f40b7900 2023-12-19T13:33:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f69eefb9640 1 -- start start 2023-12-19T13:33:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb8ce283640 1 --2- 172.21.15.6:0/2845750903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c80716b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80b9700 tx=0x7fb8bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88af07bd13904b61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895615535 0 0) 0x7fd4a0072f90 con 0x7fd498006f90 2023-12-19T13:33:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 >> v2:172.21.15.6:3300/0 conn(0x7fd4980cf4e0 msgr2=0x7fd4980cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 --2- 172.21.15.6:0/3121923588 >> v2:172.21.15.6:3300/0 conn(0x7fd4980cf4e0 0x7fd4980cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f5758003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57580047c0 0x7f5758004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5758005180 0x7f575800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5760006db0 con 0x7f5758005180 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575800c0b0 con 0x7f57580039d0 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.553+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575800c270 con 0x7f57580047c0 2023-12-19T13:33:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 >> v1:172.21.15.6:6789/0 conn(0x7fd498007370 legacy=0x7fd4980d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f576c8f9640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5758005180 0x7f575800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49803e230 con 0x7fd498006f90 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fd490001a40 con 0x7fd498006f90 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 >> v1:172.21.15.89:6789/0 conn(0x7fd498006f90 legacy=0x7fd49803a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00675c0 0x7fd4a0066c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00731b0 0x7fd4a0073630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4a00659a0 0x7fd4a0065e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980d5d20 con 0x7fd4a00675c0 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a004ef70 con 0x7fd4a00731b0 2023-12-19T13:33:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a004e5f0 con 0x7fd4a00659a0 2023-12-19T13:33:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f5767fff640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f5758003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0dc003970 0x7fb0dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb0f37fe640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc0047c0 0x7fb0dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f885cbda640 1 --2- 172.21.15.6:0/3378356650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 0x7f88580716b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f884c009870 tx=0x7f884c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2e4a33095a3e69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb8cd281640 1 -- 172.21.15.6:0/2845750903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc031640 con 0x7fb8c80b7d30 2023-12-19T13:33:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49e59c640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4a00659a0 0x7fd4a0065e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f5767fff640 1 -- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57580047c0 msgr2=0x7f5758004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f57677fe640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57580047c0 0x7f5758004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f88577fe640 1 -- 172.21.15.6:0/3378356650 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c02f830 con 0x7f885806caa0 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69eefb9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 0x7f69e80b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69eefb9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 0x7f69e80b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69eefb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813f370 0x7f69e80b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69eefb9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80b6240 con 0x7f69e80be6f0 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69eefb9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80b7720 con 0x7f69e813ef20 2023-12-19T13:33:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69eefb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80b85f0 con 0x7f69e813f370 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49dd9b640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00675c0 0x7fd4a0066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f88577fe640 1 -- 172.21.15.6:0/3378356650 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c02f990 con 0x7f885806caa0 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb8cd281640 1 -- 172.21.15.6:0/2845750903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc0317a0 con 0x7fb8c80b7d30 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f4d23fff640 1 -- 172.21.15.6:0/2444282843 >> v2:172.21.15.89:3300/0 conn(0x7f4d1c0d8c20 msgr2=0x7f4d1c0d9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f4d23fff640 1 --2- 172.21.15.6:0/2444282843 >> v2:172.21.15.89:3300/0 conn(0x7f4d1c0d8c20 0x7f4d1c0d9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f4d23fff640 1 -- 172.21.15.6:0/2444282843 >> v2:172.21.15.6:3300/0 conn(0x7f4d1c007490 msgr2=0x7f4d1c042b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f4d23fff640 1 --2- 172.21.15.6:0/2444282843 >> v2:172.21.15.6:3300/0 conn(0x7f4d1c007490 0x7f4d1c042b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.554+0000 7f4d23fff640 1 -- 172.21.15.6:0/2444282843 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c03f370 con 0x7f4d1c0cf1d0 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69ecd55640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 0x7f69e80b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69e7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 0x7f69e80b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69e7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 0x7f69e80b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40094/0 (socket says 172.21.15.6:40094) 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49e59c640 1 -- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00731b0 msgr2=0x7fd4a0073630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49e59c640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4a00731b0 0x7fd4a0073630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49e59c640 1 -- 172.21.15.6:0/3121923588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00675c0 msgr2=0x7fd4a0066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69e7fff640 1 -- 172.21.15.6:0/4249551463 learned_addr learned my addr 172.21.15.6:0/4249551463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69ed556640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813f370 0x7f69e80b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f69ecd55640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 0x7f69e80b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34610/0 (socket says 172.21.15.6:34610) 2023-12-19T13:33:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f4d23fff640 1 --2- 172.21.15.6:0/2444282843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 0x7f4d1c0cf610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c042a50 tx=0x7f4d1802b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f653f7bb2c0e5d82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb0f3fff640 1 -- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 msgr2=0x7fb0dc005180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T13:33:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0f40b7900 0x7fb0dc005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb0f3fff640 1 -- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc0047c0 msgr2=0x7fb0dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc0047c0 0x7fb0dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb0f3fff640 1 -- 172.21.15.6:0/1077127419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4071ae0 con 0x7fb0dc003970 2023-12-19T13:33:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f6049819640 1 --2- 172.21.15.6:0/884139269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60440be160 0x7f60440b5b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60440b8fe0 tx=0x7f604002b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a78880934883aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f5767fff640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57580047c0 0x7f5758004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f5767fff640 1 -- 172.21.15.6:0/3861581592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5758005180 msgr2=0x7f575800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f4d237fe640 1 -- 172.21.15.6:0/2444282843 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18030870 con 0x7f4d1c0cf1d0 2023-12-19T13:33:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69ed556640 1 -- 172.21.15.6:0/4249551463 >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 msgr2=0x7f69e80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f4d237fe640 1 -- 172.21.15.6:0/2444282843 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d180309d0 con 0x7f4d1c0cf1d0 2023-12-19T13:33:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f4d237fe640 1 -- 172.21.15.6:0/2444282843 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18030da0 con 0x7f4d1c0cf1d0 2023-12-19T13:33:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f88577fe640 1 -- 172.21.15.6:0/3378356650 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c02fd20 con 0x7f885806caa0 2023-12-19T13:33:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69ed556640 1 --2- 172.21.15.6:0/4249551463 >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 0x7f69e80b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69ed556640 1 -- 172.21.15.6:0/4249551463 >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 msgr2=0x7f69e80b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69ed556640 1 --2- 172.21.15.6:0/4249551463 >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 0x7f69e80b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69ed556640 1 -- 172.21.15.6:0/4249551463 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8142e50 con 0x7f69e813f370 2023-12-19T13:33:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f6048817640 1 -- 172.21.15.6:0/884139269 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0019f0 con 0x7f60440be160 2023-12-19T13:33:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0dc003970 0x7fb0dc003d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009fc0 tx=0x7fb0dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dcfa866e18ecd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f885dbdc640 1 -- 172.21.15.6:0/3378356650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 msgr2=0x7f88580716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f885dbdc640 1 --2- 172.21.15.6:0/3378356650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 0x7f88580716b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f884c009870 tx=0x7f884c02ba10 comp rx=0 tx=0).stop 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49e59c640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00675c0 0x7fd4a0066c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fd49e59c640 1 -- 172.21.15.6:0/3121923588 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49803e230 con 0x7fd4a00659a0 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7fd49dd9b640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00675c0 0x7fd4a0066c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7fd49e59c640 1 -- 172.21.15.6:0/3121923588 reap_dead start 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f5767fff640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5758005180 0x7f575800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f5767fff640 1 -- 172.21.15.6:0/3861581592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760029690 con 0x7f57580039d0 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7f576c8f9640 1 -- 172.21.15.6:0/3861581592 reap_dead start 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f57677fe640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57580047c0 0x7f5758004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f885dbdc640 1 -- 172.21.15.6:0/3378356650 shutdown_connections 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f885dbdc640 1 --2- 172.21.15.6:0/3378356650 >> v2:172.21.15.6:3300/0 conn(0x7f885806fdf0 0x7f8858148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f885dbdc640 1 --2- 172.21.15.6:0/3378356650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806caa0 0x7f88580716b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69e7fff640 1 --2- 172.21.15.6:0/4249551463 >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 0x7f69e80b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f69ecd55640 1 --2- 172.21.15.6:0/4249551463 >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 0x7f69e80b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f6048817640 1 -- 172.21.15.6:0/884139269 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604002e050 con 0x7f60440be160 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.555+0000 7fb8cd281640 1 -- 172.21.15.6:0/2845750903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc031b30 con 0x7fb8c80b7d30 2023-12-19T13:33:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7fb8cf285640 1 -- 172.21.15.6:0/2845750903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 msgr2=0x7fb8c80716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f885dbdc640 1 -- 172.21.15.6:0/3378356650 >> 172.21.15.6:0/3378356650 conn(0x7f88580b8890 msgr2=0x7f88580b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2845750903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c80716b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80b9700 tx=0x7fb8bc02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.556+0000 7f5767fff640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f5758003e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f575400c1b0 tx=0x7f57580057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2b78cee9630938b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb8cf285640 1 -- 172.21.15.6:0/2845750903 shutdown_connections 2023-12-19T13:33:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec02cc20 con 0x7fb0dc003970 2023-12-19T13:33:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f6048817640 1 -- 172.21.15.6:0/884139269 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040030730 con 0x7f60440be160 2023-12-19T13:33:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2845750903 >> v2:172.21.15.89:3300/0 conn(0x7fb8c8149320 0x7fb8c806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2845750903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c80716b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb8cf285640 1 -- 172.21.15.6:0/2845750903 >> 172.21.15.6:0/2845750903 conn(0x7fb8c806b820 msgr2=0x7fb8c806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec00f040 con 0x7fb0dc003970 2023-12-19T13:33:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f885dbdc640 1 -- 172.21.15.6:0/3378356650 shutdown_connections 2023-12-19T13:33:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb0f2ffd640 1 -- 172.21.15.6:0/1077127419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec034440 con 0x7fb0dc003970 2023-12-19T13:33:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fd49e59c640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4a00659a0 0x7fd4a0065e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd494009ac0 tx=0x7fd4a0072d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b4620cf2546d88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575402ca10 con 0x7f57580039d0 2023-12-19T13:33:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb8cf285640 1 -- 172.21.15.6:0/2845750903 shutdown_connections 2023-12-19T13:33:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575402cb90 con 0x7f57580039d0 2023-12-19T13:33:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f5766ffd640 1 -- 172.21.15.6:0/3861581592 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754034440 con 0x7f57580039d0 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fb8cf285640 1 -- 172.21.15.6:0/2845750903 wait complete. 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 -- 172.21.15.6:0/2444282843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 msgr2=0x7f4d1c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 --2- 172.21.15.6:0/2444282843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 0x7f4d1c0cf610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c042a50 tx=0x7f4d1802b9b0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 -- 172.21.15.6:0/2444282843 shutdown_connections 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 --2- 172.21.15.6:0/2444282843 >> v2:172.21.15.89:3300/0 conn(0x7f4d1c0d8c20 0x7f4d1c0d9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 --2- 172.21.15.6:0/2444282843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c0cf1d0 0x7f4d1c0cf610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 --2- 172.21.15.6:0/2444282843 >> v2:172.21.15.6:3300/0 conn(0x7f4d1c007490 0x7f4d1c042b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 -- 172.21.15.6:0/2444282843 >> 172.21.15.6:0/2444282843 conn(0x7f4d1c043480 msgr2=0x7f4d1c043890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 -- 172.21.15.6:0/2444282843 shutdown_connections 2023-12-19T13:33:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f885dbdc640 1 -- 172.21.15.6:0/3378356650 wait complete. 2023-12-19T13:33:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f4d2ab92640 1 -- 172.21.15.6:0/2444282843 wait complete. 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f604ba7d640 1 -- 172.21.15.6:0/884139269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60440be160 msgr2=0x7f60440b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f604ba7d640 1 --2- 172.21.15.6:0/884139269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60440be160 0x7f60440b5b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60440b8fe0 tx=0x7f604002b6c0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f604ba7d640 1 -- 172.21.15.6:0/884139269 shutdown_connections 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f604ba7d640 1 --2- 172.21.15.6:0/884139269 >> v2:172.21.15.6:3300/0 conn(0x7f604414be90 0x7f60440b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f604ba7d640 1 --2- 172.21.15.6:0/884139269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60440be160 0x7f60440b5b60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7f604ba7d640 1 -- 172.21.15.6:0/884139269 >> 172.21.15.6:0/884139269 conn(0x7f6044069d00 msgr2=0x7f604406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f604ba7d640 1 -- 172.21.15.6:0/884139269 shutdown_connections 2023-12-19T13:33:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f604ba7d640 1 -- 172.21.15.6:0/884139269 wait complete. 2023-12-19T13:33:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 -- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 msgr2=0x7f5758003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f5758003e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f575400c1b0 tx=0x7f57580057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7fb0fa71b640 1 -- 172.21.15.6:0/1077127419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0dc003970 msgr2=0x7fb0dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004020 con 0x7fd4a00659a0 2023-12-19T13:33:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494004180 con 0x7fd4a00659a0 2023-12-19T13:33:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.557+0000 7fd49cd99640 1 -- 172.21.15.6:0/3121923588 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49402c630 con 0x7fd4a00659a0 2023-12-19T13:33:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 -- 172.21.15.6:0/3861581592 shutdown_connections 2023-12-19T13:33:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 --2- 172.21.15.6:0/3861581592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f5758003e10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 -- 172.21.15.6:0/3861581592 >> 172.21.15.6:0/3861581592 conn(0x7f5760007af0 msgr2=0x7f5760007f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f69ed556640 1 --2- 172.21.15.6:0/4249551463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813f370 0x7f69e80b80b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69e81462f0 tx=0x7f69d802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be1d261bdef64fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 -- 172.21.15.6:0/3861581592 shutdown_connections 2023-12-19T13:33:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f885dbdc640 1 Processor -- start 2023-12-19T13:33:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f69e77fe640 1 -- 172.21.15.6:0/4249551463 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d802e070 con 0x7f69e813f370 2023-12-19T13:33:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f69e77fe640 1 -- 172.21.15.6:0/4249551463 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d80315a0 con 0x7f69e813f370 2023-12-19T13:33:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f69e77fe640 1 -- 172.21.15.6:0/4249551463 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8031930 con 0x7f69e813f370 2023-12-19T13:33:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4a00659a0 msgr2=0x7fd4a0065e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4a00659a0 0x7fd4a0065e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd494009ac0 tx=0x7fd4a0072d40 comp rx=0 tx=0).stop 2023-12-19T13:33:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/1077127419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0dc003970 0x7fb0dc003d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009fc0 tx=0x7fb0dc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7fb0f8cb8640 1 -- 172.21.15.6:0/1077127419 reap_dead start 2023-12-19T13:33:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/3121923588 shutdown_connections 2023-12-19T13:33:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/3121923588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4a00659a0 0x7fd4a0065e50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/3121923588 >> 172.21.15.6:0/3121923588 conn(0x7fd49803efd0 msgr2=0x7fd49803f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fb0fa71b640 1 -- 172.21.15.6:0/1077127419 shutdown_connections 2023-12-19T13:33:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fb0fa71b640 1 -- 172.21.15.6:0/1077127419 >> 172.21.15.6:0/1077127419 conn(0x7fb0f40b8810 msgr2=0x7fb0f40b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f576e35c640 1 -- 172.21.15.6:0/3861581592 wait complete. 2023-12-19T13:33:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fb8cf285640 1 Processor -- start 2023-12-19T13:33:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f4d2ab92640 1 Processor -- start 2023-12-19T13:33:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.558+0000 7f885dbdc640 1 -- start start 2023-12-19T13:33:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fb8cf285640 1 -- start start 2023-12-19T13:33:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f4d2ab92640 1 -- start start 2023-12-19T13:33:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f604ba7d640 1 Processor -- start 2023-12-19T13:33:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fb0fa71b640 1 -- 172.21.15.6:0/1077127419 shutdown_connections 2023-12-19T13:33:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f604ba7d640 1 -- start start 2023-12-19T13:33:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/3121923588 shutdown_connections 2023-12-19T13:33:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/3121923588 wait complete. 2023-12-19T13:33:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f69eefb9640 1 -- 172.21.15.6:0/4249551463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813f370 msgr2=0x7f69e80b80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f69eefb9640 1 --2- 172.21.15.6:0/4249551463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813f370 0x7f69e80b80b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69e81462f0 tx=0x7f69d802b840 comp rx=0 tx=0).stop 2023-12-19T13:33:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7fb0fa71b640 1 -- 172.21.15.6:0/1077127419 wait complete. 2023-12-19T13:33:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f576e35c640 1 Processor -- start 2023-12-19T13:33:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7fb8cf285640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c81469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f576e35c640 1 -- start start 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f604ba7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 0x7f60440bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f604ba7d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60440be160 0x7f604406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f604ba7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f604414be90 0x7f604406c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f604ba7d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60440bd6a0 con 0x7f60440b9540 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f604ba7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044141640 con 0x7f604414be90 2023-12-19T13:33:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f604ba7d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604406b950 con 0x7f60440be160 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f6049819640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 0x7f60440bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f6049819640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 0x7f60440bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34650/0 (socket says 172.21.15.6:34650) 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f6049819640 1 -- 172.21.15.6:0/3665358400 learned_addr learned my addr 172.21.15.6:0/3665358400 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f4d2ab92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 0x7f4d1c15ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2ab92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d1c0cf1d0 0x7f4d1c045ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2892e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 0x7f4d1c15ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2892e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 0x7f4d1c15ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34956/0 (socket says 172.21.15.6:34956) 2023-12-19T13:33:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2892e640 1 -- 172.21.15.6:0/3933265697 learned_addr learned my addr 172.21.15.6:0/3933265697 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cf285640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c80b8850 0x7fb8c814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cf285640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c8149320 0x7fb8c814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2ab92640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0d8c20 0x7f4d1c16e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d23fff640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d1c0cf1d0 0x7f4d1c045ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cf285640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c814f990 con 0x7fb8c80b7d30 2023-12-19T13:33:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb0fa71b640 1 Processor -- start 2023-12-19T13:33:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f6049819640 1 -- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60440be160 msgr2=0x7f604406bde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T13:33:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f6049819640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60440be160 0x7f604406bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f6049819640 1 -- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f604414be90 msgr2=0x7f604406c320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0461e0 con 0x7f4d1c0d8c20 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c6b30 con 0x7f4d1c0cf1d0 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c75d0 con 0x7f4d1c007490 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8ce283640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c81469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cea84640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c8149320 0x7fb8c814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8ce283640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c81469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34640/0 (socket says 172.21.15.6:34640) 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8ce283640 1 -- 172.21.15.6:0/2941295059 learned_addr learned my addr 172.21.15.6:0/2941295059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cda82640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c80b8850 0x7fb8c814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c814adb0 con 0x7fb8c8149320 2023-12-19T13:33:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c814b090 con 0x7fb8c80b8850 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7fb0fa71b640 1 -- start start 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f885dbdc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f885806caa0 0x7f885814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f885dbdc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806efb0 0x7f88580b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f885dbdc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 0x7f8858130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f885dbdc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885814cf30 con 0x7f885806fdf0 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f885dbdc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885814d7d0 con 0x7f885806caa0 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.559+0000 7f885dbdc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885814dc60 con 0x7f885806efb0 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f885d3db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 0x7f8858130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f885d3db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 0x7f8858130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34624/0 (socket says 172.21.15.6:34624) 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f885d3db640 1 -- 172.21.15.6:0/3128733090 learned_addr learned my addr 172.21.15.6:0/3128733090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.560+0000 7f8857fff640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806efb0 0x7f88580b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f885d3db640 1 -- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806efb0 msgr2=0x7f88580b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f885d3db640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806efb0 0x7f88580b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f885d3db640 1 -- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f885806caa0 msgr2=0x7f885814e2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f885d3db640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f885806caa0 0x7f885814e2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f885d3db640 1 -- 172.21.15.6:0/3128733090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0094d0 con 0x7f885806fdf0 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f885d3db640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 0x7f8858130060 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f884800b7b0 tx=0x7f884800bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f69eefb9640 1 -- 172.21.15.6:0/4249551463 shutdown_connections 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f69eefb9640 1 --2- 172.21.15.6:0/4249551463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813f370 0x7f69e80b80b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f69eefb9640 1 --2- 172.21.15.6:0/4249551463 >> v2:172.21.15.89:3300/0 conn(0x7f69e813ef20 0x7f69e80b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f69eefb9640 1 --2- 172.21.15.6:0/4249551463 >> v2:172.21.15.6:3300/0 conn(0x7f69e80be6f0 0x7f69e80b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f69eefb9640 1 -- 172.21.15.6:0/4249551463 >> 172.21.15.6:0/4249551463 conn(0x7f69e8069ee0 msgr2=0x7f69e806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f576e35c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f57600d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f576e35c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57600d1410 0x7f576016bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f576e35c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57600d2670 0x7f5760038f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800c720 con 0x7f885806fdf0 2023-12-19T13:33:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f69eefb9640 1 -- 172.21.15.6:0/4249551463 shutdown_connections 2023-12-19T13:33:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f69eefb9640 1 -- 172.21.15.6:0/4249551463 wait complete. 2023-12-19T13:33:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f57600d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fd4a4d4e640 1 Processor -- start 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f57600d50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40148/0 (socket says 172.21.15.6:40148) 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 -- 172.21.15.6:0/2014995671 learned_addr learned my addr 172.21.15.6:0/2014995671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576003bbf0 con 0x7f57600d2670 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600d55e0 con 0x7f57580039d0 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f6049819640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f604414be90 0x7f604406c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f6049819640 1 -- 172.21.15.6:0/3665358400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009400 con 0x7f60440b9540 2023-12-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fd4a4d4e640 1 -- start start 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57600d21e0 con 0x7f57600d1410 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb8cea84640 1 -- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c80b8850 msgr2=0x7fb8c814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb8cea84640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c80b8850 0x7fb8c814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb8cea84640 1 -- 172.21.15.6:0/2941295059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 msgr2=0x7fb8c81469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb8cea84640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c81469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb8cea84640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc009400 con 0x7fb8c8149320 2023-12-19T13:33:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.561+0000 7f4d29930640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0d8c20 0x7f4d1c16e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0fa71b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc003970 0x7fb0f4143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0fa71b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 0x7fb0f41418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0fa71b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f40b5b00 0x7fb0f413e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0fa71b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4144230 con 0x7fb0f4142310 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0fa71b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41406c0 con 0x7fb0f40b5b00 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0fa71b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4141460 con 0x7fb0dc003970 2023-12-19T13:33:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f576c8f9640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57600d2670 0x7f5760038f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 -- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57600d1410 msgr2=0x7f576016bb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 0x7fb0f41418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 0x7fb0f41418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34676/0 (socket says 172.21.15.6:34676) 2023-12-19T13:33:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0f37fe640 1 -- 172.21.15.6:0/310353741 learned_addr learned my addr 172.21.15.6:0/310353741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57600d1410 0x7f576016bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 -- 172.21.15.6:0/2014995671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57600d2670 msgr2=0x7f5760038f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc003970 0x7fb0f4143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f5767fff640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57600d2670 0x7f5760038f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f5767fff640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600d18b0 con 0x7f57580039d0 2023-12-19T13:33:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f576c8f9640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57600d2670 0x7f5760038f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb8cea84640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c8149320 0x7fb8c814cae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000be20 tx=0x7fb8c000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800c880 con 0x7f885806fdf0 2023-12-19T13:33:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800cc10 con 0x7f885806fdf0 2023-12-19T13:33:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f885dbdc640 1 -- 172.21.15.6:0/3128733090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885814eae0 con 0x7f885806fdf0 2023-12-19T13:33:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.562+0000 7f885dbdc640 1 -- 172.21.15.6:0/3128733090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885814aca0 con 0x7f885806fdf0 2023-12-19T13:33:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d2892e640 1 -- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d1c0cf1d0 msgr2=0x7f4d1c045ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f5767fff640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f57600d50a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f575400c1b0 tx=0x7f57540019e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d2892e640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d1c0cf1d0 0x7f4d1c045ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d2892e640 1 -- 172.21.15.6:0/3933265697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0d8c20 msgr2=0x7f4d1c16e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d2892e640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0d8c20 0x7f4d1c16e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb0f37fe640 1 -- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc003970 msgr2=0x7fb0f4143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb0f37fe640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc003970 0x7fb0f4143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb0f37fe640 1 -- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f40b5b00 msgr2=0x7fb0f413e750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000ce70 con 0x7fb8c8149320 2023-12-19T13:33:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d2892e640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180094d0 con 0x7f4d1c007490 2023-12-19T13:33:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb0f37fe640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f40b5b00 0x7fb0f413e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb0f37fe640 1 -- 172.21.15.6:0/310353741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40b5040 con 0x7fb0f4142310 2023-12-19T13:33:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fd4a4d4e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 0x7fd4980c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0014440 con 0x7fb8c8149320 2023-12-19T13:33:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7f6049819640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 0x7f60440bd160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6040009890 tx=0x7f60400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000ce70 con 0x7fb8c8149320 2023-12-19T13:33:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c814b370 con 0x7fb8c8149320 2023-12-19T13:33:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c814c3d0 con 0x7fb8c8149320 2023-12-19T13:33:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d2892e640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 0x7f4d1c15ea60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d24069120 tx=0x7f4d24067050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2406cea0 con 0x7f4d1c007490 2023-12-19T13:33:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2404ef70 con 0x7f4d1c007490 2023-12-19T13:33:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24073970 con 0x7f4d1c007490 2023-12-19T13:33:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7fb0f37fe640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 0x7fb0f41418d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8000fb0 tx=0x7fb0e800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7f885dbdc640 1 -- 172.21.15.6:0/3128733090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858061910 con 0x7f885806fdf0 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f69eefb9640 1 Processor -- start 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd49dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 0x7fd4980c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd49dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 0x7fd4980c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34690/0 (socket says 172.21.15.6:34690) 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd49dd9b640 1 -- 172.21.15.6:0/2721625481 learned_addr learned my addr 172.21.15.6:0/2721625481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd498037650 0x7fd4980c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd498035300 0x7fd4980357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980c7880 con 0x7fd4a00659a0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd49d59a640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd498037650 0x7fd4980c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd49e59c640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd498035300 0x7fd4980357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4981627c0 con 0x7fd498035300 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980c68a0 con 0x7fd498037650 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540347f0 con 0x7f57580039d0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57600d1b90 con 0x7f57580039d0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754034950 con 0x7f57580039d0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.563+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576016c050 con 0x7f57580039d0 2023-12-19T13:33:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540347f0 con 0x7f57580039d0 2023-12-19T13:33:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0c6d30 con 0x7f4d1c007490 2023-12-19T13:33:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c0c72f0 con 0x7f4d1c007490 2023-12-19T13:33:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.564+0000 7f69eefb9640 1 -- start start 2023-12-19T13:33:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69eefb9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e80be6f0 0x7f69e80bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69eefb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 0x7f69e81e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69eefb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 0x7f69e813dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fd49e59c640 1 -- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd498037650 msgr2=0x7fd4980c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fd49e59c640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd498037650 0x7fd4980c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fd49e59c640 1 -- 172.21.15.6:0/2721625481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 msgr2=0x7fd4980c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fd49e59c640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 0x7fd4980c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fd49e59c640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498162170 con 0x7fd498035300 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69eefb9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e813cbc0 con 0x7f69e80be6f0 2023-12-19T13:33:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69eefb9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8135680 con 0x7f69e813f370 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69eefb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e813ce10 con 0x7f69e813ef20 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 0x7f69e81e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 0x7f69e813dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 0x7f69e813dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40166/0 (socket says 172.21.15.6:40166) 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 0x7f69e81e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34974/0 (socket says 172.21.15.6:34974) 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 -- 172.21.15.6:0/2255738276 learned_addr learned my addr 172.21.15.6:0/2255738276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604003c820 con 0x7f60440b9540 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f604ba7d640 1 -- 172.21.15.6:0/3665358400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6044141fc0 con 0x7f60440b9540 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604003c9a0 con 0x7f60440b9540 2023-12-19T13:33:13.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604003cd50 con 0x7f60440b9540 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 -- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 msgr2=0x7f69e81e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 0x7f69e81e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 -- 172.21.15.6:0/2255738276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e80be6f0 msgr2=0x7f69e80bd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7f69ed556640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e80be6f0 0x7f69e80bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7f69ed556640 1 -- 172.21.15.6:0/2255738276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc009400 con 0x7f69e813f370 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7f69e7fff640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 0x7f69e81e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:13.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576016c050 con 0x7f57580039d0 2023-12-19T13:33:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c814b890 con 0x7fb8c8149320 2023-12-19T13:33:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7f604ba7d640 1 -- 172.21.15.6:0/3665358400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6044141b10 con 0x7f60440b9540 2023-12-19T13:33:13.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7fd49e59c640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd498035300 0x7fd4980357b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd498040420 tx=0x7fd494004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800c8d0 con 0x7fb0f4142310 2023-12-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800ca30 con 0x7fb0f4142310 2023-12-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.565+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800cde0 con 0x7fb0f4142310 2023-12-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f40b4a80 con 0x7fb0f4142310 2023-12-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7f69ed556640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 0x7f69e813dca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69d802b880 tx=0x7f69d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c005890 con 0x7f4d1c007490 2023-12-19T13:33:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7fd49dd9b640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 0x7fd4980c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.566+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4141e10 con 0x7fb0f4142310 2023-12-19T13:33:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8848014440 con 0x7f885806fdf0 2023-12-19T13:33:13.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb8c001d3b0 con 0x7fb8c8149320 2023-12-19T13:33:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7f604ba7d640 1 -- 172.21.15.6:0/3665358400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6044061910 con 0x7f60440b9540 2023-12-19T13:33:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7fb8baffd640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb8ac06a490 0x7fb8ac06c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f575403b070 con 0x7f57580039d0 2023-12-19T13:33:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7f88557fa640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f884406a500 0x7f884406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8c0088670 con 0x7fb8c8149320 2023-12-19T13:33:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.567+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8848088790 con 0x7f885806fdf0 2023-12-19T13:33:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f885cbda640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f884406a500 0x7f884406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7fb8ce283640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb8ac06a490 0x7fb8ac06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f5764ff9640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f574c06a4f0 0x7f574c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d2409b440 con 0x7f4d1c007490 2023-12-19T13:33:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57540aaa00 con 0x7f57580039d0 2023-12-19T13:33:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f57677fe640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f574c06a4f0 0x7f574c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40b48e0 con 0x7fb0f4142310 2023-12-19T13:33:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f885cbda640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f884406a500 0x7f884406c9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f884c036000 tx=0x7f884c039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7fb8ce283640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb8ac06a490 0x7fb8ac06c950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc02b930 tx=0x7fb8bc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f4d217fa640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4d0806a4b0 0x7f4d0806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d241021f0 con 0x7f4d1c007490 2023-12-19T13:33:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.568+0000 7f4d23fff640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4d0806a4b0 0x7f4d0806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.569+0000 7f57677fe640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f574c06a4f0 0x7f574c06c9b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5768000b60 tx=0x7f576806e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.569+0000 7f4d23fff640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4d0806a4b0 0x7f4d0806c970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d18036000 tx=0x7f4d18008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8032840 con 0x7f69e813f370 2023-12-19T13:33:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e0009b30 con 0x7f69e813f370 2023-12-19T13:33:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494038030 con 0x7fd498035300 2023-12-19T13:33:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd498162450 con 0x7fd498035300 2023-12-19T13:33:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd498161e80 con 0x7fd498035300 2023-12-19T13:33:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d8009400 con 0x7f69e813f370 2023-12-19T13:33:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.571+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5754075f50 con 0x7f57580039d0 2023-12-19T13:33:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.572+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8848053e10 con 0x7f885806fdf0 2023-12-19T13:33:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.572+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d240cd870 con 0x7f4d1c007490 2023-12-19T13:33:13.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.573+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8073a40 con 0x7f69e813f370 2023-12-19T13:33:13.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.573+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4981625e0 con 0x7fd498035300 2023-12-19T13:33:13.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.574+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6040039070 con 0x7f60440b9540 2023-12-19T13:33:13.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.574+0000 7f603a7fc640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f602806a500 0x7f602806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.575+0000 7f6049018640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f602806a500 0x7f602806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.575+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60400aa790 con 0x7f60440b9540 2023-12-19T13:33:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.575+0000 7f6049018640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f602806a500 0x7f602806c9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f603c007fd0 tx=0x7f603c0018a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.576+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8031ed0 con 0x7f69e813f370 2023-12-19T13:33:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.576+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8032ba0 con 0x7f69e813f370 2023-12-19T13:33:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.576+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb8c814b890 con 0x7fb8c8149320 2023-12-19T13:33:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.576+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0e801d460 con 0x7fb0f4142310 2023-12-19T13:33:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.577+0000 7fb0f0ff9640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb0e006a460 0x7fb0e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.577+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0e8089210 con 0x7fb0f4142310 2023-12-19T13:33:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.576+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494039040 con 0x7fd498035300 2023-12-19T13:33:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.576+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494003a10 con 0x7fd498035300 2023-12-19T13:33:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.578+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb0e006a460 0x7fb0e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.578+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd494003b70 con 0x7fd498035300 2023-12-19T13:33:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.578+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69d8032d00 con 0x7f69e813f370 2023-12-19T13:33:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7fd48effd640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd48406a460 0x7fd48406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4940a9670 con 0x7fd498035300 2023-12-19T13:33:13.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7f69e57fa640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f69d406a430 0x7f69d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:13.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7fd49dd9b640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd48406a460 0x7fd48406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69d80aafc0 con 0x7f69e813f370 2023-12-19T13:33:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7fb0f3fff640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb0e006a460 0x7fb0e006c920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec036000 tx=0x7fb0ec02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.579+0000 7f69ecd55640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f69d406a430 0x7f69d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.580+0000 7fd49dd9b640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd48406a460 0x7fd48406c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd490015d60 tx=0x7fd490017040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.580+0000 7f69ecd55640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f69d406a430 0x7f69d406c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009bf0 tx=0x7f69dc009690 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.581+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6040075df0 con 0x7f60440b9540 2023-12-19T13:33:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.582+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd494074be0 con 0x7fd498035300 2023-12-19T13:33:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.585+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0e8054750 con 0x7fb0f4142310 2023-12-19T13:33:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.586+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f69d8076600 con 0x7f69e813f370 2023-12-19T13:33:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.982+0000 7f885dbdc640 1 -- 172.21.15.6:0/3128733090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f88580b70d0 con 0x7f885806fdf0 2023-12-19T13:33:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.983+0000 7f88557fa640 1 -- 172.21.15.6:0/3128733090 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8848023020 con 0x7f885806fdf0 2023-12-19T13:33:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.983+0000 7f4d2ab92640 1 -- 172.21.15.6:0/3933265697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d1c0d6330 con 0x7f4d1c007490 2023-12-19T13:33:13.985 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-12-19T13:33:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.983+0000 7f4d217fa640 1 -- 172.21.15.6:0/3933265697 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d24096090 con 0x7f4d1c007490 2023-12-19T13:33:13.985 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-12-19T13:33:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.986+0000 7f883effd640 1 -- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f884406a500 msgr2=0x7f884406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.986+0000 7f883effd640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f884406a500 0x7f884406c9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f884c036000 tx=0x7f884c039040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.986+0000 7f883effd640 1 -- 172.21.15.6:0/3128733090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 msgr2=0x7f8858130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.986+0000 7f883effd640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 0x7f8858130060 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f884800b7b0 tx=0x7f884800bc70 comp rx=0 tx=0).stop 2023-12-19T13:33:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.986+0000 7f4d0effd640 1 -- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4d0806a4b0 msgr2=0x7f4d0806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f4d0effd640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4d0806a4b0 0x7f4d0806c970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d18036000 tx=0x7f4d18008030 comp rx=0 tx=0).stop 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 -- 172.21.15.6:0/3128733090 shutdown_connections 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f884406a500 0x7f884406c9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885806fdf0 0x7f8858130060 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f885806efb0 0x7f88580b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 --2- 172.21.15.6:0/3128733090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f885806caa0 0x7f885814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 -- 172.21.15.6:0/3128733090 >> 172.21.15.6:0/3128733090 conn(0x7f88580b8890 msgr2=0x7f8858142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 -- 172.21.15.6:0/3128733090 shutdown_connections 2023-12-19T13:33:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f883effd640 1 -- 172.21.15.6:0/3128733090 wait complete. 2023-12-19T13:33:13.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f4d0effd640 1 -- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 msgr2=0x7f4d1c15ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f4d0effd640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 0x7f4d1c15ea60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d24069120 tx=0x7f4d24067050 comp rx=0 tx=0).stop 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f4d0effd640 1 -- 172.21.15.6:0/3933265697 shutdown_connections 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f4d0effd640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4d0806a4b0 0x7f4d0806c970 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.987+0000 7f4d0effd640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d1c0d8c20 0x7f4d1c16e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.988+0000 7f4d0effd640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d1c0cf1d0 0x7f4d1c045ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.988+0000 7f4d0effd640 1 --2- 172.21.15.6:0/3933265697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d1c007490 0x7f4d1c15ea60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.988+0000 7f4d0effd640 1 -- 172.21.15.6:0/3933265697 >> 172.21.15.6:0/3933265697 conn(0x7f4d1c043480 msgr2=0x7f4d1c0ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.988+0000 7f4d0effd640 1 -- 172.21.15.6:0/3933265697 shutdown_connections 2023-12-19T13:33:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.988+0000 7f4d0effd640 1 -- 172.21.15.6:0/3933265697 wait complete. 2023-12-19T13:33:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.992+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd498005440 con 0x7fd498035300 2023-12-19T13:33:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.992+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f576016c050 con 0x7f57580039d0 2023-12-19T13:33:13.995 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.993+0000 7f5764ff9640 1 -- 172.21.15.6:0/2014995671 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5754079570 con 0x7f57580039d0 2023-12-19T13:33:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.993+0000 7fd48effd640 1 -- 172.21.15.6:0/2721625481 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd494078200 con 0x7fd498035300 2023-12-19T13:33:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.995+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb8c8061910 con 0x7fb8c8149320 2023-12-19T13:33:13.997 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2023-12-19T13:33:13.998 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.995+0000 7fb8baffd640 1 -- 172.21.15.6:0/2941295059 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8c814b890 con 0x7fb8c8149320 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.996+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f574c06a4f0 msgr2=0x7f574c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.996+0000 7f576e35c640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f574c06a4f0 0x7f574c06c9b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5768000b60 tx=0x7f576806e040 comp rx=0 tx=0).stop 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.996+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 msgr2=0x7f57600d50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.996+0000 7f576e35c640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f57600d50a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f575400c1b0 tx=0x7f57540019e0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 shutdown_connections 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f574c06a4f0 0x7f574c06c9b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57600d2670 0x7f5760038f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57600d1410 0x7f576016bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 --2- 172.21.15.6:0/2014995671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57580039d0 0x7f57600d50a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 >> 172.21.15.6:0/2014995671 conn(0x7f5760007af0 msgr2=0x7f57600cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd48406a460 msgr2=0x7fd48406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd48406a460 0x7fd48406c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd490015d60 tx=0x7fd490017040 comp rx=0 tx=0).stop 2023-12-19T13:33:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd498035300 msgr2=0x7fd4980357b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd498035300 0x7fd4980357b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd498040420 tx=0x7fd494004730 comp rx=0 tx=0).stop 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 shutdown_connections 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd48406a460 0x7fd48406c920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd498035300 0x7fd4980357b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd498037650 0x7fd4980c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 --2- 172.21.15.6:0/2721625481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4a00659a0 0x7fd4980c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 >> 172.21.15.6:0/2721625481 conn(0x7fd49803efd0 msgr2=0x7fd498041140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.997+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 shutdown_connections 2023-12-19T13:33:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7f576e35c640 1 -- 172.21.15.6:0/2014995671 wait complete. 2023-12-19T13:33:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 shutdown_connections 2023-12-19T13:33:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7fd4a4d4e640 1 -- 172.21.15.6:0/2721625481 wait complete. 2023-12-19T13:33:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb8ac06a490 msgr2=0x7fb8ac06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7f604ba7d640 1 -- 172.21.15.6:0/3665358400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6044142260 con 0x7f60440b9540 2023-12-19T13:33:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb8ac06a490 0x7fb8ac06c950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc02b930 tx=0x7fb8bc03c040 comp rx=0 tx=0).stop 2023-12-19T13:33:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c8149320 msgr2=0x7fb8c814cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.998+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c8149320 0x7fb8c814cae0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000be20 tx=0x7fb8c000bf10 comp rx=0 tx=0).stop 2023-12-19T13:33:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7f603a7fc640 1 -- 172.21.15.6:0/3665358400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6040079410 con 0x7f60440b9540 2023-12-19T13:33:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 shutdown_connections 2023-12-19T13:33:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb8ac06a490 0x7fb8ac06c950 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c8149320 0x7fb8c814cae0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c80b8850 0x7fb8c814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.004 INFO:teuthology.orchestra.run.smithi006.stdout:55834574852 2023-12-19T13:33:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7fb8cf285640 1 --2- 172.21.15.6:0/2941295059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8c80b7d30 0x7fb8c81469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:13.999+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 >> 172.21.15.6:0/2941295059 conn(0x7fb8c806b820 msgr2=0x7fb8c80b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.000+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 shutdown_connections 2023-12-19T13:33:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.000+0000 7fb8cf285640 1 -- 172.21.15.6:0/2941295059 wait complete. 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 -- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f602806a500 msgr2=0x7f602806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f602806a500 0x7f602806c9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f603c007fd0 tx=0x7f603c0018a0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 -- 172.21.15.6:0/3665358400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 msgr2=0x7f60440bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 0x7f60440bd160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6040009890 tx=0x7f60400046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 -- 172.21.15.6:0/3665358400 shutdown_connections 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f602806a500 0x7f602806c9c0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f603c007fd0 tx=0x7f603c0018a0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f604414be90 0x7f604406c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60440be160 0x7f604406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 --2- 172.21.15.6:0/3665358400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60440b9540 0x7f60440bd160 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 -- 172.21.15.6:0/3665358400 >> 172.21.15.6:0/3665358400 conn(0x7f6044069d00 msgr2=0x7f6044070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 -- 172.21.15.6:0/3665358400 shutdown_connections 2023-12-19T13:33:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.003+0000 7f6027fff640 1 -- 172.21.15.6:0/3665358400 wait complete. 2023-12-19T13:33:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.006+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb0f40b48e0 con 0x7fb0f4142310 2023-12-19T13:33:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.007+0000 7fb0f0ff9640 1 -- 172.21.15.6:0/310353741 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0f40b48e0 con 0x7fb0f4142310 2023-12-19T13:33:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.008+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69e81460d0 con 0x7f69e813f370 2023-12-19T13:33:14.010 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.008+0000 7f69e57fa640 1 -- 172.21.15.6:0/2255738276 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69d8079c20 con 0x7f69e813f370 2023-12-19T13:33:14.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-12-19T13:33:14.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-19T13:33:14.012 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f69d406a430 msgr2=0x7f69d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f69d406a430 0x7f69d406c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009bf0 tx=0x7f69dc009690 comp rx=0 tx=0).stop 2023-12-19T13:33:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 msgr2=0x7f69e813dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 0x7f69e813dca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69d802b880 tx=0x7f69d80046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb0e006a460 msgr2=0x7fb0e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb0e006a460 0x7fb0e006c920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec036000 tx=0x7fb0ec02e000 comp rx=0 tx=0).stop 2023-12-19T13:33:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 msgr2=0x7fb0f41418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 0x7fb0f41418d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8000fb0 tx=0x7fb0e800eda0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 shutdown_connections 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f69d406a430 0x7f69d406c8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e813f370 0x7f69e813dca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e813ef20 0x7f69e81e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 --2- 172.21.15.6:0/2255738276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e80be6f0 0x7f69e80bd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 >> 172.21.15.6:0/2255738276 conn(0x7f69e8069ee0 msgr2=0x7f69e80bb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 shutdown_connections 2023-12-19T13:33:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.011+0000 7f69eefb9640 1 -- 172.21.15.6:0/2255738276 wait complete. 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 shutdown_connections 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb0e006a460 0x7fb0e006c920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f40b5b00 0x7fb0f413e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0f4142310 0x7fb0f41418d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 --2- 172.21.15.6:0/310353741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc003970 0x7fb0f4143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 >> 172.21.15.6:0/310353741 conn(0x7fb0f40b8810 msgr2=0x7fb0f40b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 shutdown_connections 2023-12-19T13:33:14.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:14.012+0000 7fb0fa71b640 1 -- 172.21.15.6:0/310353741 wait complete. 2023-12-19T13:33:14.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-12-19T13:33:14.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-12-19T13:33:14.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-12-19T13:33:14.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-19T13:33:14.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-12-19T13:33:14.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-12-19T13:33:15.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T13:33:15.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T13:33:15.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T13:33:15.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T13:33:15.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T13:33:15.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T13:33:15.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T13:33:15.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T13:33:15.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.190+0000 7fedcce7a640 1 Processor -- start 2023-12-19T13:33:15.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.190+0000 7fedcce7a640 1 -- start start 2023-12-19T13:33:15.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.192+0000 7f73a50a1640 1 Processor -- start 2023-12-19T13:33:15.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.191+0000 7fedcce7a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0008d50 0x7fedc00d9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.191+0000 7fedcce7a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedc000b440 0x7fedc00dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.191+0000 7fedcce7a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc003f540 con 0x7fedc0043110 2023-12-19T13:33:15.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.192+0000 7fedcce7a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc0042e50 con 0x7fedc000b440 2023-12-19T13:33:15.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.192+0000 7fedcce7a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc003eef0 con 0x7fedc0008d50 2023-12-19T13:33:15.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.192+0000 7fedc6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedc000b440 0x7fedc00dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7fedc6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedc000b440 0x7fedc00dfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34706/0 (socket says 172.21.15.6:34706) 2023-12-19T13:33:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7fedc6d9d640 1 -- 172.21.15.6:0/1490344507 learned_addr learned my addr 172.21.15.6:0/1490344507 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.192+0000 7f73a50a1640 1 -- start start 2023-12-19T13:33:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7f73a50a1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73a014a8f0 0x7f73a0070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7fedc6d9d640 1 -- 172.21.15.6:0/1490344507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0008d50 msgr2=0x7fedc00d9420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:33:15.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7f73a50a1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a006f210 con 0x7f73a006a150 2023-12-19T13:33:15.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7f73a50a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a006f4b0 con 0x7f73a006a530 2023-12-19T13:33:15.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7f73a50a1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a0071090 con 0x7f73a014a8f0 2023-12-19T13:33:15.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.194+0000 7f739ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f73a006a150 0x7f73a00b5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56368/0 (socket says 172.21.15.6:56368) 2023-12-19T13:33:15.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.194+0000 7f739ed9d640 1 -- 172.21.15.6:0/718759851 learned_addr learned my addr 172.21.15.6:0/718759851 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7fedc6d9d640 1 --2- 172.21.15.6:0/1490344507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0008d50 0x7fedc00d9420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7fedc6d9d640 1 -- 172.21.15.6:0/1490344507 >> v1:172.21.15.6:6789/0 conn(0x7fedc0043110 legacy=0x7fedc0041910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T13:33:15.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.193+0000 7fedc6d9d640 1 -- 172.21.15.6:0/1490344507 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc003f1d0 con 0x7fedc000b440 2023-12-19T13:33:15.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7f739f59e640 1 --2- 172.21.15.6:0/718759851 >> v2:172.21.15.6:3300/0 conn(0x7f73a014a8f0 0x7f73a0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7fedc6d9d640 1 --2- 172.21.15.6:0/1490344507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc000b440 0x7fedc00dfff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedc8069120 tx=0x7fedc8067530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b8213f3e3f30fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7f739f59e640 1 -- 172.21.15.6:0/718759851 >> v1:172.21.15.89:6789/0 conn(0x7f73a006a530 legacy=0x7f73a014a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7fedc559a640 1 -- 172.21.15.6:0/1490344507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc806cea0 con 0x7fedc000b440 2023-12-19T13:33:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7f739dd9b640 1 -- 172.21.15.6:0/718759851 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136685030 0 0) 0x7f73a006f4b0 con 0x7f73a006a530 2023-12-19T13:33:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7fedc559a640 1 -- 172.21.15.6:0/1490344507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc80a77c0 con 0x7fedc000b440 2023-12-19T13:33:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.195+0000 7fedc559a640 1 -- 172.21.15.6:0/1490344507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc80a7c10 con 0x7fedc000b440 2023-12-19T13:33:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.196+0000 7f739f59e640 1 -- 172.21.15.6:0/718759851 >> v1:172.21.15.6:6789/0 conn(0x7f73a006a150 legacy=0x7f73a00b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.196+0000 7f739f59e640 1 -- 172.21.15.6:0/718759851 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a006f790 con 0x7f73a014a8f0 2023-12-19T13:33:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.196+0000 7fedcce7a640 1 -- 172.21.15.6:0/1490344507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc000b440 msgr2=0x7fedc00dfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.196+0000 7fedcce7a640 1 --2- 172.21.15.6:0/1490344507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc000b440 0x7fedc00dfff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedc8069120 tx=0x7fedc8067530 comp rx=0 tx=0).stop 2023-12-19T13:33:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.197+0000 7f739f59e640 1 --2- 172.21.15.6:0/718759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a014a8f0 0x7f73a0070290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7394009a00 tx=0x7f739402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841e6b5c41bd6fa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.197+0000 7fedcce7a640 1 -- 172.21.15.6:0/1490344507 shutdown_connections 2023-12-19T13:33:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.197+0000 7fedcce7a640 1 --2- 172.21.15.6:0/1490344507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc000b440 0x7fedc00dfff0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.197+0000 7fedcce7a640 1 --2- 172.21.15.6:0/1490344507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0008d50 0x7fedc00d9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.197+0000 7fedcce7a640 1 -- 172.21.15.6:0/1490344507 >> 172.21.15.6:0/1490344507 conn(0x7fedc000a510 msgr2=0x7fedc000a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.198+0000 7fedcce7a640 1 -- 172.21.15.6:0/1490344507 shutdown_connections 2023-12-19T13:33:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.198+0000 7f739dd9b640 1 -- 172.21.15.6:0/718759851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394030620 con 0x7f73a014a8f0 2023-12-19T13:33:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.198+0000 7f739dd9b640 1 -- 172.21.15.6:0/718759851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7394030780 con 0x7f73a014a8f0 2023-12-19T13:33:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.199+0000 7f73a50a1640 1 -- 172.21.15.6:0/718759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a014a8f0 msgr2=0x7f73a0070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.199+0000 7f73a50a1640 1 --2- 172.21.15.6:0/718759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a014a8f0 0x7f73a0070290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7394009a00 tx=0x7f739402b9f0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.198+0000 7fedcce7a640 1 -- 172.21.15.6:0/1490344507 wait complete. 2023-12-19T13:33:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7f73a50a1640 1 -- 172.21.15.6:0/718759851 shutdown_connections 2023-12-19T13:33:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7f73a50a1640 1 --2- 172.21.15.6:0/718759851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a014a8f0 0x7f73a0070290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7f73a50a1640 1 -- 172.21.15.6:0/718759851 >> 172.21.15.6:0/718759851 conn(0x7f73a00bc120 msgr2=0x7f73a00bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7f73a50a1640 1 -- 172.21.15.6:0/718759851 shutdown_connections 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7fedcce7a640 1 Processor -- start 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7fedcce7a640 1 -- start start 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.201+0000 7fedcce7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc0008d50 0x7fedc00cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.201+0000 7fedcce7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc000b440 0x7fedc0038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.201+0000 7fedcce7a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 0x7fedc003b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.201+0000 7fedcce7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00d8db0 con 0x7fedc0008d50 2023-12-19T13:33:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.201+0000 7fedcce7a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0022ac0 con 0x7fedc000b440 2023-12-19T13:33:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.201+0000 7fedcce7a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00c9b80 con 0x7fedc0038560 2023-12-19T13:33:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc6d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 0x7fedc003b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc6d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 0x7fedc003b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:34980/0 (socket says 172.21.15.6:34980) 2023-12-19T13:33:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.200+0000 7f73a50a1640 1 -- 172.21.15.6:0/718759851 wait complete. 2023-12-19T13:33:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7f73a50a1640 1 Processor -- start 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc6d9d640 1 -- 172.21.15.6:0/2274728768 learned_addr learned my addr 172.21.15.6:0/2274728768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc5d9b640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc000b440 0x7fedc0038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc6d9d640 1 -- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc000b440 msgr2=0x7fedc0038b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc6d9d640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc000b440 0x7fedc0038b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7fedc6d9d640 1 -- 172.21.15.6:0/2274728768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc0008d50 msgr2=0x7fedc00cc4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7fedc659c640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc0008d50 0x7fedc00cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7fedc6d9d640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc0008d50 0x7fedc00cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7fedc6d9d640 1 -- 172.21.15.6:0/2274728768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8072f90 con 0x7fedc0038560 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7fedc659c640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc0008d50 0x7fedc00cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7fedc6d9d640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 0x7fedc003b850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedc804f2f0 tx=0x7fedc8072d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc806cea0 con 0x7fedc0038560 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7fedcce7a640 1 -- 172.21.15.6:0/2274728768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc00c98a0 con 0x7fedc0038560 2023-12-19T13:33:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7fedcce7a640 1 -- 172.21.15.6:0/2274728768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc003cc30 con 0x7fedc0038560 2023-12-19T13:33:15.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc80afc60 con 0x7fedc0038560 2023-12-19T13:33:15.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc80a7660 con 0x7fedc0038560 2023-12-19T13:33:15.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.206+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fedc80b9650 con 0x7fedc0038560 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.202+0000 7f73a50a1640 1 -- start start 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f73a50a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73a006a150 0x7f73a0143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f73a50a1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 0x7f73a01efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f73a50a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73a014a8f0 0x7f73a01f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f73a50a1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0146ae0 con 0x7f73a006a530 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f73a50a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0147640 con 0x7f73a006a150 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f73a50a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0147850 con 0x7f73a014a8f0 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f739e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 0x7f73a01efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f739e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 0x7f73a01efaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2023-12-19T13:33:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.203+0000 7f739e59c640 1 -- 172.21.15.6:0/466507681 learned_addr learned my addr 172.21.15.6:0/466507681 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7f739ed9d640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73a006a150 0x7f73a0143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7f739e59c640 1 -- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73a014a8f0 msgr2=0x7f73a01f0030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7f739e59c640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73a014a8f0 0x7f73a01f0030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7f739e59c640 1 -- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73a006a150 msgr2=0x7f73a0143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7f739e59c640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73a006a150 0x7f73a0143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.204+0000 7f739e59c640 1 -- 172.21.15.6:0/466507681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009400 con 0x7f73a006a530 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.206+0000 7f739e59c640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 0x7f73a01efaf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f739800caa0 tx=0x7f739800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.207+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398003970 con 0x7f73a006a530 2023-12-19T13:33:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.207+0000 7f73a50a1640 1 -- 172.21.15.6:0/466507681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a01472e0 con 0x7f73a006a530 2023-12-19T13:33:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.208+0000 7fedb6ffd640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feda806a4d0 0x7feda806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.208+0000 7fedc659c640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feda806a4d0 0x7feda806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.207+0000 7f73a50a1640 1 -- 172.21.15.6:0/466507681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a0143460 con 0x7f73a006a530 2023-12-19T13:33:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.208+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedc80ab070 con 0x7fedc0038560 2023-12-19T13:33:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.209+0000 7fedc659c640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feda806a4d0 0x7feda806c990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00a810 tx=0x7fedbc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.209+0000 7fedcce7a640 1 -- 172.21.15.6:0/2274728768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac005250 con 0x7fedc0038560 2023-12-19T13:33:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.209+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398003af0 con 0x7f73a006a530 2023-12-19T13:33:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.209+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398003ea0 con 0x7f73a006a530 2023-12-19T13:33:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.210+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f739800a7f0 con 0x7f73a006a530 2023-12-19T13:33:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.210+0000 7f73877fe640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f738806a650 0x7f738806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.211+0000 7f73a50a1640 1 -- 172.21.15.6:0/466507681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7380005250 con 0x7f73a006a530 2023-12-19T13:33:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.211+0000 7f739ed9d640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f738806a650 0x7f738806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.212+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73980a9fe0 con 0x7f73a006a530 2023-12-19T13:33:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.212+0000 7f739ed9d640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f738806a650 0x7f738806cb10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7390007bd0 tx=0x7f7390007b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.215+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fedc80f0700 con 0x7fedc0038560 2023-12-19T13:33:15.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.220+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7398075720 con 0x7f73a006a530 2023-12-19T13:33:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.240+0000 7fcb0359e640 1 Processor -- start 2023-12-19T13:33:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.240+0000 7fcb0359e640 1 -- start start 2023-12-19T13:33:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.241+0000 7fcb0359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb0406caa0 0x7fcb0406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.241+0000 7fcb0359e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb04070560 con 0x7fcb0406f850 2023-12-19T13:33:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.241+0000 7fcb0359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0406ff10 con 0x7fcb040b7050 2023-12-19T13:33:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.241+0000 7fcb0359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406fd00 con 0x7fcb0406caa0 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb01d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcb0406f850 0x7fcb040b6940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56378/0 (socket says 172.21.15.6:56378) 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb01d9b640 1 -- 172.21.15.6:0/3062550828 learned_addr learned my addr 172.21.15.6:0/3062550828 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb0259c640 1 --2- 172.21.15.6:0/3062550828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb0406caa0 0x7fcb0406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb0159a640 1 -- 172.21.15.6:0/3062550828 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758323154 0 0) 0x7fcb04070560 con 0x7fcb0406f850 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb0159a640 1 -- 172.21.15.6:0/3062550828 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaec003520 con 0x7fcb0406f850 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7f91a825f640 1 Processor -- start 2023-12-19T13:33:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.243+0000 7f7265749640 1 Processor -- start 2023-12-19T13:33:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb0259c640 1 -- 172.21.15.6:0/3062550828 >> v1:172.21.15.89:6789/0 conn(0x7fcb040b7050 legacy=0x7fcb041402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb0259c640 1 -- 172.21.15.6:0/3062550828 >> v1:172.21.15.6:6789/0 conn(0x7fcb0406f850 legacy=0x7fcb040b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7fcb0259c640 1 -- 172.21.15.6:0/3062550828 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040701f0 con 0x7fcb0406caa0 2023-12-19T13:33:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.242+0000 7f91a825f640 1 -- start start 2023-12-19T13:33:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.243+0000 7f91a825f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91980cb330 0x7f9198040780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f91a5ffb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f91980072b0 0x7f91980d0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59788/0 (socket says 172.21.15.6:59788) 2023-12-19T13:33:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.243+0000 7f7265749640 1 -- start start 2023-12-19T13:33:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f7265749640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007f70 0x7f7258006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f7265749640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725803c680 con 0x7f72580d9250 2023-12-19T13:33:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f7265749640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725803bf80 con 0x7f7258007860 2023-12-19T13:33:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f7265749640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580069b0 con 0x7f7258007f70 2023-12-19T13:33:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7fcb0259c640 1 --2- 172.21.15.6:0/3062550828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb0406caa0 0x7fcb0406ead0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400ba80 tx=0x7fcaf402dfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8eb18106148c4da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f7264f48640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72580d9250 0x7f72580cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56408/0 (socket says 172.21.15.6:56408) 2023-12-19T13:33:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f7264f48640 1 -- 172.21.15.6:0/2000516807 learned_addr learned my addr 172.21.15.6:0/2000516807 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7fcb0159a640 1 -- 172.21.15.6:0/3062550828 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf402ed90 con 0x7fcb0406caa0 2023-12-19T13:33:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7fcb0159a640 1 -- 172.21.15.6:0/3062550828 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4032070 con 0x7fcb0406caa0 2023-12-19T13:33:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7fcb0159a640 1 -- 172.21.15.6:0/3062550828 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4038620 con 0x7fcb0406caa0 2023-12-19T13:33:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f725f7fe640 1 --2- 172.21.15.6:0/2000516807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007f70 0x7f7258006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7faf89226640 1 Processor -- start 2023-12-19T13:33:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f725f7fe640 1 -- 172.21.15.6:0/2000516807 >> v1:172.21.15.89:6789/0 conn(0x7f7258007860 legacy=0x7f72580d8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f725f7fe640 1 -- 172.21.15.6:0/2000516807 >> v1:172.21.15.6:6789/0 conn(0x7f72580d9250 legacy=0x7f72580cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f725f7fe640 1 -- 172.21.15.6:0/2000516807 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725803c8b0 con 0x7f7258007f70 2023-12-19T13:33:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f725effd640 1 -- 172.21.15.6:0/2000516807 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325258998 0 0) 0x7f725803bf80 con 0x7f7258007860 2023-12-19T13:33:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f91a57fa640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9198042ac0 0x7f91980cac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56392/0 (socket says 172.21.15.6:56392) 2023-12-19T13:33:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7fcb0359e640 1 -- 172.21.15.6:0/3062550828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb0406caa0 msgr2=0x7fcb0406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3062550828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb0406caa0 0x7fcb0406ead0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400ba80 tx=0x7fcaf402dfe0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.244+0000 7f91a57fa640 1 -- 172.21.15.6:0/1704019039 learned_addr learned my addr 172.21.15.6:0/1704019039 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9198042fe0 con 0x7f9198042ac0 2023-12-19T13:33:15.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7fcb0359e640 1 -- 172.21.15.6:0/3062550828 shutdown_connections 2023-12-19T13:33:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3062550828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb0406caa0 0x7fcb0406ead0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7fcb0359e640 1 -- 172.21.15.6:0/3062550828 >> 172.21.15.6:0/3062550828 conn(0x7fcb040b8890 msgr2=0x7fcb040b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919803dd90 con 0x7f91980072b0 2023-12-19T13:33:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919803e5b0 con 0x7f91980cb330 2023-12-19T13:33:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7f91a67fc640 1 --2- 172.21.15.6:0/1704019039 >> v2:172.21.15.89:3300/0 conn(0x7f91980cb330 0x7f9198040780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7f91a67fc640 1 -- 172.21.15.6:0/1704019039 >> v1:172.21.15.89:6789/0 conn(0x7f91980072b0 legacy=0x7f91980d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.245+0000 7faf89226640 1 -- start start 2023-12-19T13:33:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf89226640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf840b91d0 0x7faf84071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf89226640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b7fe0 con 0x7faf840b8ac0 2023-12-19T13:33:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf89226640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b9710 con 0x7faf840b7ac0 2023-12-19T13:33:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf89226640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840b9f10 con 0x7faf840b91d0 2023-12-19T13:33:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7f91a67fc640 1 -- 172.21.15.6:0/1704019039 >> v1:172.21.15.6:6789/0 conn(0x7f9198042ac0 legacy=0x7f91980cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7f91a67fc640 1 -- 172.21.15.6:0/1704019039 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919803e7c0 con 0x7f91980cb330 2023-12-19T13:33:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf8359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf840b91d0 0x7faf84071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf8259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7faf840b7ac0 0x7faf84148bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59812/0 (socket says 172.21.15.6:59812) 2023-12-19T13:33:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7faf8259c640 1 -- 172.21.15.6:0/4226547826 learned_addr learned my addr 172.21.15.6:0/4226547826 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7fc3a359e640 1 Processor -- start 2023-12-19T13:33:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7faf8359e640 1 -- 172.21.15.6:0/4226547826 >> v1:172.21.15.89:6789/0 conn(0x7faf840b7ac0 legacy=0x7faf84148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7faf8359e640 1 -- 172.21.15.6:0/4226547826 >> v1:172.21.15.6:6789/0 conn(0x7faf840b8ac0 legacy=0x7faf841523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7faf8359e640 1 -- 172.21.15.6:0/4226547826 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840b99f0 con 0x7faf840b91d0 2023-12-19T13:33:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.246+0000 7fcb0359e640 1 -- 172.21.15.6:0/3062550828 shutdown_connections 2023-12-19T13:33:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7f725f7fe640 1 --2- 172.21.15.6:0/2000516807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007f70 0x7f7258006270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097d0 tx=0x7f724c02b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3c39e8c50d652e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7f725effd640 1 -- 172.21.15.6:0/2000516807 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c030710 con 0x7f7258007f70 2023-12-19T13:33:15.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7f725effd640 1 -- 172.21.15.6:0/2000516807 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c02e050 con 0x7f7258007f70 2023-12-19T13:33:15.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7f725effd640 1 -- 172.21.15.6:0/2000516807 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c030a90 con 0x7f7258007f70 2023-12-19T13:33:15.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7fcb0359e640 1 -- 172.21.15.6:0/3062550828 wait complete. 2023-12-19T13:33:15.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.247+0000 7fc3a359e640 1 -- start start 2023-12-19T13:33:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f65cb59e640 1 Processor -- start 2023-12-19T13:33:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f91a67fc640 1 --2- 172.21.15.6:0/1704019039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980cb330 0x7f9198040780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91a004f2f0 tx=0x7f91a0067530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d34851059460a54d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f65cb59e640 1 -- start start 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7fc3a359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0d87c0 0x7fc39c0dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7fc3a359e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c03cc60 con 0x7fc39c03baa0 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7fc3a359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c03cf40 con 0x7fc39c006bc0 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7fc3a359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c03e0a0 con 0x7fc39c0d87c0 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f7265749640 1 -- 172.21.15.6:0/2000516807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007f70 msgr2=0x7f7258006270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f7265749640 1 --2- 172.21.15.6:0/2000516807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007f70 0x7f7258006270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097d0 tx=0x7f724c02b760 comp rx=0 tx=0).stop 2023-12-19T13:33:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7fc3a259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc39c006bc0 0x7fc39c0c8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59826/0 (socket says 172.21.15.6:59826) 2023-12-19T13:33:15.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7fc3a259c640 1 -- 172.21.15.6:0/3330968764 learned_addr learned my addr 172.21.15.6:0/3330968764 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f91a4ff9640 1 -- 172.21.15.6:0/1704019039 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a006cea0 con 0x7f91980cb330 2023-12-19T13:33:15.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f91a4ff9640 1 -- 172.21.15.6:0/1704019039 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a00a8050 con 0x7f91980cb330 2023-12-19T13:33:15.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7f91a4ff9640 1 -- 172.21.15.6:0/1704019039 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00aaa90 con 0x7f91980cb330 2023-12-19T13:33:15.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.248+0000 7faf8359e640 1 --2- 172.21.15.6:0/4226547826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b91d0 0x7faf84071dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf78009720 tx=0x7faf7802b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2466b6fb15560b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729493892 0 0) 0x7fc39c03cf40 con 0x7fc39c006bc0 2023-12-19T13:33:15.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc38c003520 con 0x7fc39c006bc0 2023-12-19T13:33:15.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7faf81d9b640 1 -- 172.21.15.6:0/4226547826 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78031520 con 0x7faf840b91d0 2023-12-19T13:33:15.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7faf81d9b640 1 -- 172.21.15.6:0/4226547826 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78031680 con 0x7faf840b91d0 2023-12-19T13:33:15.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7faf81d9b640 1 -- 172.21.15.6:0/4226547826 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78031a10 con 0x7faf840b91d0 2023-12-19T13:33:15.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fcb0359e640 1 Processor -- start 2023-12-19T13:33:15.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2566413686 0 0) 0x7fc38c003520 con 0x7fc39c006bc0 2023-12-19T13:33:15.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0d87c0 msgr2=0x7fc39c0dabb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T13:33:15.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0d87c0 0x7fc39c0dabb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 >> v1:172.21.15.6:6789/0 conn(0x7fc39c03baa0 legacy=0x7fc39c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c03d220 con 0x7fc39c006bc0 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fc3a4072f90 con 0x7fc39c006bc0 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 >> v1:172.21.15.89:6789/0 conn(0x7fc39c006bc0 legacy=0x7fc39c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc38c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f65cb59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65cc0bace0 0x7f65cc0b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f65cb59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc14b140 0x7f65cc0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f65cb59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc0ba230 con 0x7f65cc0b7ac0 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f65cb59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc06c370 con 0x7f65cc0bace0 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f65cb59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc06af40 con 0x7f65cc14b140 2023-12-19T13:33:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980cb330 msgr2=0x7f9198040780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f91a825f640 1 --2- 172.21.15.6:0/1704019039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980cb330 0x7f9198040780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91a004f2f0 tx=0x7f91a0067530 comp rx=0 tx=0).stop 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c0047c0 0x7fc38c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c005180 0x7fc38c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c00c000 con 0x7fc38c003970 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c00c140 con 0x7fc38c005180 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c00c300 con 0x7fc38c0047c0 2023-12-19T13:33:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fc3a259c640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc38c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 shutdown_connections 2023-12-19T13:33:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f91a825f640 1 --2- 172.21.15.6:0/1704019039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980cb330 0x7f9198040780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 >> 172.21.15.6:0/1704019039 conn(0x7f91980432a0 msgr2=0x7f91980436b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7f65c9d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f65cc0b7ac0 0x7f65cc14aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59830/0 (socket says 172.21.15.6:59830) 2023-12-19T13:33:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65c9d9b640 1 -- 172.21.15.6:0/903296317 learned_addr learned my addr 172.21.15.6:0/903296317 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65cad9d640 1 --2- 172.21.15.6:0/903296317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc14b140 0x7f65cc0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.249+0000 7fcb0359e640 1 -- start start 2023-12-19T13:33:15.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65ca59c640 1 --2- 172.21.15.6:0/903296317 >> v2:172.21.15.6:3300/0 conn(0x7f65cc0bace0 0x7f65cc0b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 -- 172.21.15.6:0/4226547826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b91d0 msgr2=0x7faf84071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 --2- 172.21.15.6:0/4226547826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b91d0 0x7faf84071dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf78009720 tx=0x7faf7802b7c0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 shutdown_connections 2023-12-19T13:33:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65c959a640 1 -- 172.21.15.6:0/903296317 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738523464 0 0) 0x7f65cc0ba230 con 0x7f65cc0b7ac0 2023-12-19T13:33:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 -- 172.21.15.6:0/4226547826 shutdown_connections 2023-12-19T13:33:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 --2- 172.21.15.6:0/4226547826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b91d0 0x7faf84071dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 -- 172.21.15.6:0/4226547826 >> 172.21.15.6:0/4226547826 conn(0x7faf8406b690 msgr2=0x7faf8406baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65c959a640 1 -- 172.21.15.6:0/903296317 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b4003520 con 0x7f65cc0b7ac0 2023-12-19T13:33:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 -- 172.21.15.6:0/4226547826 shutdown_connections 2023-12-19T13:33:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7faf89226640 1 -- 172.21.15.6:0/4226547826 wait complete. 2023-12-19T13:33:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7f7265749640 1 -- 172.21.15.6:0/2000516807 shutdown_connections 2023-12-19T13:33:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7f7265749640 1 --2- 172.21.15.6:0/2000516807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007f70 0x7f7258006270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7f7265749640 1 -- 172.21.15.6:0/2000516807 >> 172.21.15.6:0/2000516807 conn(0x7f7258006b00 msgr2=0x7f7258006ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65cad9d640 1 -- 172.21.15.6:0/903296317 >> v2:172.21.15.6:3300/0 conn(0x7f65cc0bace0 msgr2=0x7f65cc0b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65cad9d640 1 --2- 172.21.15.6:0/903296317 >> v2:172.21.15.6:3300/0 conn(0x7f65cc0bace0 0x7f65cc0b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65cad9d640 1 -- 172.21.15.6:0/903296317 >> v1:172.21.15.89:6789/0 conn(0x7f65cc0b7ac0 legacy=0x7f65cc14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f65cad9d640 1 -- 172.21.15.6:0/903296317 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc06b220 con 0x7f65cc14b140 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7fc3a259c640 1 -- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c0047c0 msgr2=0x7fc38c004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7fc3a259c640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c0047c0 0x7fc38c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7fc3a259c640 1 -- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c005180 msgr2=0x7fc38c00b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7fc3a259c640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c005180 0x7fc38c00b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7fc3a259c640 1 -- 172.21.15.6:0/3330968764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c03d220 con 0x7fc38c003970 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb0359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb0406caa0 0x7fcb041ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fc3a259c640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc38c003d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40639d0 tx=0x7fc38c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34be5872a673320 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7f7265749640 1 -- 172.21.15.6:0/2000516807 shutdown_connections 2023-12-19T13:33:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a406cea0 con 0x7fc38c003970 2023-12-19T13:33:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.250+0000 7f91a825f640 1 -- 172.21.15.6:0/1704019039 wait complete. 2023-12-19T13:33:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a40a6b30 con 0x7fc38c003970 2023-12-19T13:33:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fc3a159a640 1 -- 172.21.15.6:0/3330968764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40af470 con 0x7fc38c003970 2023-12-19T13:33:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7f91a825f640 1 Processor -- start 2023-12-19T13:33:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7f7265749640 1 -- 172.21.15.6:0/2000516807 wait complete. 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb0359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb0406f850 0x7fcb040b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb0359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 0x7fcb0413cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb0359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b52e0 con 0x7fcb0406caa0 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb0359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041d11e0 con 0x7fcb0406f850 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb0359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b3510 con 0x7fcb040b7050 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb02d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 0x7fcb0413cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb02d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 0x7fcb0413cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:35034/0 (socket says 172.21.15.6:35034) 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb02d9d640 1 -- 172.21.15.6:0/3155962838 learned_addr learned my addr 172.21.15.6:0/3155962838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.251+0000 7fcb01d9b640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb0406f850 0x7fcb040b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7f91a825f640 1 -- start start 2023-12-19T13:33:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7f65cad9d640 1 --2- 172.21.15.6:0/903296317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc14b140 0x7f65cc0b7f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009d90 tx=0x7f65c402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35769b9525e6f235 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7f65c959a640 1 -- 172.21.15.6:0/903296317 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c402cc60 con 0x7f65cc14b140 2023-12-19T13:33:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7fcb02d9d640 1 -- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb0406f850 msgr2=0x7fcb040b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7fcb02d9d640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb0406f850 0x7fcb040b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7fcb02d9d640 1 -- 172.21.15.6:0/3155962838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb0406caa0 msgr2=0x7fcb041ccb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7faf89226640 1 Processor -- start 2023-12-19T13:33:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7fcb02d9d640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb0406caa0 0x7fcb041ccb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7faf89226640 1 -- start start 2023-12-19T13:33:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7fcb02d9d640 1 -- 172.21.15.6:0/3155962838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf400b6b0 con 0x7fcb040b7050 2023-12-19T13:33:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7fcb02d9d640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 0x7fcb0413cf30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c3c0 tx=0x7fcaf800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7f65c959a640 1 -- 172.21.15.6:0/903296317 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c402cdc0 con 0x7f65cc14b140 2023-12-19T13:33:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.252+0000 7f65c959a640 1 -- 172.21.15.6:0/903296317 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4034660 con 0x7f65cc14b140 2023-12-19T13:33:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fc3a359e640 1 -- 172.21.15.6:0/3330968764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 msgr2=0x7fc38c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f91a825f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 0x7f91981736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fc3a359e640 1 --2- 172.21.15.6:0/3330968764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc38c003d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40639d0 tx=0x7fc38c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f91a825f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9198042ac0 0x7f91980cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fc3a2d9d640 1 -- 172.21.15.6:0/3330968764 reap_dead start 2023-12-19T13:33:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80035f0 con 0x7fcb040b7050 2023-12-19T13:33:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f7265749640 1 Processor -- start 2023-12-19T13:33:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0413f000 con 0x7fcb040b7050 2023-12-19T13:33:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f65cb59e640 1 -- 172.21.15.6:0/903296317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc14b140 msgr2=0x7f65cc0b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f65cb59e640 1 --2- 172.21.15.6:0/903296317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc14b140 0x7f65cc0b7f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009d90 tx=0x7f65c402beb0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0413da50 con 0x7fcb040b7050 2023-12-19T13:33:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7faf89226640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 0x7faf8414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f65cb59e640 1 -- 172.21.15.6:0/903296317 shutdown_connections 2023-12-19T13:33:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f65cb59e640 1 --2- 172.21.15.6:0/903296317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc14b140 0x7f65cc0b7f30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f65cb59e640 1 --2- 172.21.15.6:0/903296317 >> v2:172.21.15.6:3300/0 conn(0x7f65cc0bace0 0x7f65cc0b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f65cb59e640 1 -- 172.21.15.6:0/903296317 >> 172.21.15.6:0/903296317 conn(0x7f65cc069d00 msgr2=0x7f65cc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f91a5ffb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 0x7f91981736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f91a5ffb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 0x7f91981736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40218/0 (socket says 172.21.15.6:40218) 2023-12-19T13:33:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f91a5ffb640 1 -- 172.21.15.6:0/883885759 learned_addr learned my addr 172.21.15.6:0/883885759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7f7265749640 1 -- start start 2023-12-19T13:33:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8003770 con 0x7fcb040b7050 2023-12-19T13:33:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.253+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8003b20 con 0x7fcb040b7050 2023-12-19T13:33:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91980cb330 0x7f9198044600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf82d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 0x7faf8414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf82d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 0x7faf8414daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34756/0 (socket says 172.21.15.6:34756) 2023-12-19T13:33:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f65cb59e640 1 -- 172.21.15.6:0/903296317 shutdown_connections 2023-12-19T13:33:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf82d9d640 1 -- 172.21.15.6:0/1605806839 learned_addr learned my addr 172.21.15.6:0/1605806839 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b8ac0 0x7faf841e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9198044f60 con 0x7f9198042ac0 2023-12-19T13:33:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b91d0 0x7faf84143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980cf380 con 0x7f91980072b0 2023-12-19T13:33:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf8259c640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b8ac0 0x7faf841e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9198045c50 con 0x7f91980cb330 2023-12-19T13:33:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf841e4050 con 0x7faf840b7ac0 2023-12-19T13:33:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8414ce20 con 0x7faf840b8ac0 2023-12-19T13:33:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf841e42a0 con 0x7faf840b91d0 2023-12-19T13:33:15.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a67fc640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91980cb330 0x7f9198044600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7fc3a359e640 1 -- 172.21.15.6:0/3330968764 shutdown_connections 2023-12-19T13:33:15.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf8359e640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b91d0 0x7faf84143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7fc3a359e640 1 -- 172.21.15.6:0/3330968764 >> 172.21.15.6:0/3330968764 conn(0x7fc39c005ec0 msgr2=0x7fc39c0062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a5ffb640 1 -- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91980cb330 msgr2=0x7f9198044600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf82d9d640 1 -- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b91d0 msgr2=0x7faf84143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf82d9d640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b91d0 0x7faf84143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7faf82d9d640 1 -- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b8ac0 msgr2=0x7faf841e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf82d9d640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b8ac0 0x7faf841e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf82d9d640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009400 con 0x7faf840b7ac0 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8005250 con 0x7fcb040b7050 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7265749640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007860 0x7f7258041e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7265749640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 0x7f72580c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7265749640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72580d9250 0x7f72580c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7265749640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580cb870 con 0x7f7258007f70 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7265749640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7258036a50 con 0x7f72580d9250 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7265749640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7258042390 con 0x7f7258007860 2023-12-19T13:33:15.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f725f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 0x7f72580c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f725f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 0x7f72580c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34758/0 (socket says 172.21.15.6:34758) 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f725f7fe640 1 -- 172.21.15.6:0/2096335248 learned_addr learned my addr 172.21.15.6:0/2096335248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7f7264f48640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72580d9250 0x7f72580c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf82d9d640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 0x7faf8414daf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c450 tx=0x7faf7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740052d0 con 0x7faf840b7ac0 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74005430 con 0x7faf840b7ac0 2023-12-19T13:33:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7fc3a359e640 1 -- 172.21.15.6:0/3330968764 shutdown_connections 2023-12-19T13:33:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f65cb59e640 1 -- 172.21.15.6:0/903296317 wait complete. 2023-12-19T13:33:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf84152c60 con 0x7faf840b7ac0 2023-12-19T13:33:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7fc3a359e640 1 -- 172.21.15.6:0/3330968764 wait complete. 2023-12-19T13:33:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.255+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf84144500 con 0x7faf840b7ac0 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f725f7fe640 1 -- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007860 msgr2=0x7f7258041e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f725f7fe640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007860 0x7f7258041e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f725f7fe640 1 -- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72580d9250 msgr2=0x7f72580c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f725f7fe640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72580d9250 0x7f72580c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f725f7fe640 1 -- 172.21.15.6:0/2096335248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c009400 con 0x7f7258007f70 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f725f7fe640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 0x7f72580c7ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097d0 tx=0x7f724c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcaf8003c80 con 0x7fcb040b7050 2023-12-19T13:33:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7fcaf2ffd640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcae406a500 0x7fcae406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f65cb59e640 1 Processor -- start 2023-12-19T13:33:15.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a5ffb640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91980cb330 0x7f9198044600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a5ffb640 1 -- 172.21.15.6:0/883885759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9198042ac0 msgr2=0x7f91980cdaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T13:33:15.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c032910 con 0x7f7258007f70 2023-12-19T13:33:15.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a5ffb640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9198042ac0 0x7f91980cdaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.254+0000 7f91a5ffb640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0072f90 con 0x7f91980072b0 2023-12-19T13:33:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaf8087dd0 con 0x7fcb040b7050 2023-12-19T13:33:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.256+0000 7f65cb59e640 1 -- start start 2023-12-19T13:33:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65cb59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0b7ac0 0x7f65cc146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65cb59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0bace0 0x7f65cc145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7fc3a359e640 1 Processor -- start 2023-12-19T13:33:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7fc3a359e640 1 -- start start 2023-12-19T13:33:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7fcb0259c640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcae406a500 0x7fcae406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65cb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65cc14b140 0x7f65cc1485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65c9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0bace0 0x7f65cc145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f91a5ffb640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 0x7f91981736e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c480 tx=0x7f919c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74012870 con 0x7faf840b7ac0 2023-12-19T13:33:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf84073a40 con 0x7faf840b7ac0 2023-12-19T13:33:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65c9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0bace0 0x7f65cc145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:40258/0 (socket says 172.21.15.6:40258) 2023-12-19T13:33:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fcb0259c640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcae406a500 0x7fcae406c9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4039000 tx=0x7fcaf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65c9d9b640 1 -- 172.21.15.6:0/2385295856 learned_addr learned my addr 172.21.15.6:0/2385295856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f65cad9d640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65cc14b140 0x7f65cc1485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f65ca59c640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0b7ac0 0x7f65cc146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc148b00 con 0x7f65cc14b140 2023-12-19T13:33:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0ab340 con 0x7f65cc0bace0 2023-12-19T13:33:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc149110 con 0x7f65cc0b7ac0 2023-12-19T13:33:15.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc39c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c0d8160 0x7fc39c0d5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc39c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0cfac0 0x7fc39c0d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580cb090 con 0x7f7258007f70 2023-12-19T13:33:15.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.257+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72580cb350 con 0x7f7258007f70 2023-12-19T13:33:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0d6380 con 0x7fc38c003970 2023-12-19T13:33:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc39c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34772/0 (socket says 172.21.15.6:34772) 2023-12-19T13:33:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a259c640 1 -- 172.21.15.6:0/116235660 learned_addr learned my addr 172.21.15.6:0/116235660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0c9bc0 con 0x7fc39c0d8160 2023-12-19T13:33:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c172e70 con 0x7fc39c0cfac0 2023-12-19T13:33:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7fc3a2d9d640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0cfac0 0x7fc39c0d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c007480 con 0x7f91980072b0 2023-12-19T13:33:15.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c0075e0 con 0x7f91980072b0 2023-12-19T13:33:15.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c005a50 con 0x7f91980072b0 2023-12-19T13:33:15.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7fc3a1d9b640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c0d8160 0x7fc39c0d5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf740129d0 con 0x7faf840b7ac0 2023-12-19T13:33:15.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91980cf5f0 con 0x7f91980072b0 2023-12-19T13:33:15.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91980d0ad0 con 0x7f91980072b0 2023-12-19T13:33:15.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.258+0000 7f65cad9d640 1 -- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0b7ac0 msgr2=0x7f65cc146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580057d0 con 0x7f7258007f70 2023-12-19T13:33:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7fc3a2d9d640 1 -- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c0d8160 msgr2=0x7fc39c0d5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7fc3a2d9d640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c0d8160 0x7fc39c0d5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7fc3a2d9d640 1 -- 172.21.15.6:0/116235660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 msgr2=0x7fc39c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7fc3a2d9d640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc39c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7fc3a2d9d640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c173150 con 0x7fc39c0cfac0 2023-12-19T13:33:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7faf6b7fe640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7faf7006a430 0x7faf7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f65cad9d640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0b7ac0 0x7f65cc146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f65cad9d640 1 -- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0bace0 msgr2=0x7f65cc145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f65cad9d640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0bace0 0x7f65cc145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f65cad9d640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4009a70 con 0x7f65cc14b140 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.259+0000 7f65cad9d640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65cc14b140 0x7f65cc1485c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65c4033000 tx=0x7f65c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c032a70 con 0x7f7258007f70 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c032e20 con 0x7f7258007f70 2023-12-19T13:33:15.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf74088420 con 0x7faf840b7ac0 2023-12-19T13:33:15.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7faf8259c640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7faf7006a430 0x7faf7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9198008720 con 0x7f91980072b0 2023-12-19T13:33:15.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.260+0000 7fc3a2d9d640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0cfac0 0x7fc39c0d5c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e3e0 tx=0x7fc3940097a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f724c039040 con 0x7f7258007f70 2023-12-19T13:33:15.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940052d0 con 0x7fc39c0cfac0 2023-12-19T13:33:15.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394005450 con 0x7fc39c0cfac0 2023-12-19T13:33:15.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394003850 con 0x7fc39c0cfac0 2023-12-19T13:33:15.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcaf808b030 con 0x7fcb040b7050 2023-12-19T13:33:15.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7f725cff9640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f724406a500 0x7f724406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f724c0aa5b0 con 0x7f7258007f70 2023-12-19T13:33:15.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c173430 con 0x7fc39c0cfac0 2023-12-19T13:33:15.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c0c97f0 con 0x7fc39c0cfac0 2023-12-19T13:33:15.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.261+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f919c005bb0 con 0x7f91980072b0 2023-12-19T13:33:15.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.262+0000 7faf8259c640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7faf7006a430 0x7faf7006c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf7c007ed0 tx=0x7faf7c007e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.262+0000 7f91967fc640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f918406a480 0x7f918406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.262+0000 7f725ffff640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f724406a500 0x7f724406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.262+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f919c053950 con 0x7f91980072b0 2023-12-19T13:33:15.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.263+0000 7f91a57fa640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f918406a480 0x7f918406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.263+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c172ca0 con 0x7fc39c0cfac0 2023-12-19T13:33:15.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.263+0000 7f725ffff640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f724406a500 0x7f724406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f72540015a0 tx=0x7f72540078b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.263+0000 7f91a57fa640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f918406a480 0x7f918406c940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f91980cf270 tx=0x7f9190007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.263+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc3940039b0 con 0x7fc39c0cfac0 2023-12-19T13:33:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.264+0000 7fc392ffd640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc38406a480 0x7fc38406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.264+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3940876a0 con 0x7fc39c0cfac0 2023-12-19T13:33:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.265+0000 7fc3a259c640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc38406a480 0x7fc38406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.265+0000 7fc3a259c640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc38406a480 0x7fc38406c940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3a402c8b0 tx=0x7fc3a40b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.267+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f919c005e60 con 0x7f91980072b0 2023-12-19T13:33:15.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.268+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc394052d30 con 0x7fc39c0cfac0 2023-12-19T13:33:15.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.268+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faf74053a00 con 0x7faf840b7ac0 2023-12-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.269+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c403e610 con 0x7f65cc14b140 2023-12-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.269+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc1452a0 con 0x7f65cc14b140 2023-12-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.269+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc145860 con 0x7f65cc14b140 2023-12-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.270+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc145a50 con 0x7f65cc14b140 2023-12-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.278+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c403e770 con 0x7f65cc14b140 2023-12-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.278+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f724c075e60 con 0x7f7258007f70 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.281+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c403eae0 con 0x7f65cc14b140 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.281+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f65c403b050 con 0x7f65cc14b140 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.281+0000 7f65baffd640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f65ac06a430 0x7f65ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.282+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65c40ab630 con 0x7f65cc14b140 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.287+0000 7f65ca59c640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f65ac06a430 0x7f65ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.287+0000 7f65ca59c640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f65ac06a430 0x7f65ac06c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006fd0 tx=0x7f65bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.289+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f65c4076d20 con 0x7f65cc14b140 2023-12-19T13:33:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.614+0000 7fedcce7a640 1 -- 172.21.15.6:0/2274728768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedac005500 con 0x7fedc0038560 2023-12-19T13:33:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.615+0000 7fedb6ffd640 1 -- 172.21.15.6:0/2274728768 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedc80f3d20 con 0x7fedc0038560 2023-12-19T13:33:15.617 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 -- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feda806a4d0 msgr2=0x7feda806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feda806a4d0 0x7feda806c990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00a810 tx=0x7fedbc008040 comp rx=0 tx=0).stop 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 -- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 msgr2=0x7fedc003b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 0x7fedc003b850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedc804f2f0 tx=0x7fedc8072d40 comp rx=0 tx=0).stop 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 -- 172.21.15.6:0/2274728768 shutdown_connections 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feda806a4d0 0x7feda806c990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc0038560 0x7fedc003b850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc000b440 0x7fedc0038b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.618+0000 7fedb4ff9640 1 --2- 172.21.15.6:0/2274728768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc0008d50 0x7fedc00cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.619+0000 7fedb4ff9640 1 -- 172.21.15.6:0/2274728768 >> 172.21.15.6:0/2274728768 conn(0x7fedc000a510 msgr2=0x7fedc0041910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.619+0000 7fedb4ff9640 1 -- 172.21.15.6:0/2274728768 shutdown_connections 2023-12-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.619+0000 7fedb4ff9640 1 -- 172.21.15.6:0/2274728768 wait complete. 2023-12-19T13:33:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.629+0000 7f73a50a1640 1 -- 172.21.15.6:0/466507681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7380005500 con 0x7f73a006a530 2023-12-19T13:33:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.630+0000 7f73877fe640 1 -- 172.21.15.6:0/466507681 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7398039020 con 0x7f73a006a530 2023-12-19T13:33:15.632 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-12-19T13:33:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 -- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f738806a650 msgr2=0x7f738806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f738806a650 0x7f738806cb10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7390007bd0 tx=0x7f7390007b20 comp rx=0 tx=0).stop 2023-12-19T13:33:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 -- 172.21.15.6:0/466507681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 msgr2=0x7f73a01efaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 0x7f73a01efaf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f739800caa0 tx=0x7f739800cf60 comp rx=0 tx=0).stop 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 -- 172.21.15.6:0/466507681 shutdown_connections 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f738806a650 0x7f738806cb10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73a014a8f0 0x7f73a01f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a006a530 0x7f73a01efaf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 --2- 172.21.15.6:0/466507681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73a006a150 0x7f73a0143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 -- 172.21.15.6:0/466507681 >> 172.21.15.6:0/466507681 conn(0x7f73a00bc120 msgr2=0x7f73a00b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 -- 172.21.15.6:0/466507681 shutdown_connections 2023-12-19T13:33:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.633+0000 7f73857fa640 1 -- 172.21.15.6:0/466507681 wait complete. 2023-12-19T13:33:15.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-19T13:33:15.638 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-19T13:33:15.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.651+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcae8005500 con 0x7fcb040b7050 2023-12-19T13:33:15.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.651+0000 7fcaf2ffd640 1 -- 172.21.15.6:0/3155962838 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcaf8053450 con 0x7fcb040b7050 2023-12-19T13:33:15.654 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.654 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:15.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcae406a500 msgr2=0x7fcae406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcae406a500 0x7fcae406c9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4039000 tx=0x7fcaf4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:15.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 msgr2=0x7fcb0413cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 0x7fcb0413cf30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c3c0 tx=0x7fcaf800c880 comp rx=0 tx=0).stop 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 shutdown_connections 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcae406a500 0x7fcae406c9c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040b7050 0x7fcb0413cf30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb0406f850 0x7fcb040b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 --2- 172.21.15.6:0/3155962838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb0406caa0 0x7fcb041ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 >> 172.21.15.6:0/3155962838 conn(0x7fcb040b8890 msgr2=0x7fcb040b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 shutdown_connections 2023-12-19T13:33:15.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.653+0000 7fcb0359e640 1 -- 172.21.15.6:0/3155962838 wait complete. 2023-12-19T13:33:15.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-12-19T13:33:15.666 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.669+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f65cc061910 con 0x7f65cc14b140 2023-12-19T13:33:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.670+0000 7f65baffd640 1 -- 172.21.15.6:0/2385295856 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65c407a340 con 0x7f65cc14b140 2023-12-19T13:33:15.672 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f65ac06a430 msgr2=0x7f65ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f65ac06a430 0x7f65ac06c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006fd0 tx=0x7f65bc008040 comp rx=0 tx=0).stop 2023-12-19T13:33:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65cc14b140 msgr2=0x7f65cc1485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65cc14b140 0x7f65cc1485c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65c4033000 tx=0x7f65c4004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 shutdown_connections 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f65ac06a430 0x7f65ac06c8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65cc14b140 0x7f65cc1485c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0bace0 0x7f65cc145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 --2- 172.21.15.6:0/2385295856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0b7ac0 0x7f65cc146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 >> 172.21.15.6:0/2385295856 conn(0x7f65cc069d00 msgr2=0x7f65cc0b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 shutdown_connections 2023-12-19T13:33:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.672+0000 7f65cb59e640 1 -- 172.21.15.6:0/2385295856 wait complete. 2023-12-19T13:33:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.676+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9198173ce0 con 0x7f91980072b0 2023-12-19T13:33:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.677+0000 7f91967fc640 1 -- 172.21.15.6:0/883885759 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f919c017030 con 0x7f91980072b0 2023-12-19T13:33:15.679 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f918406a480 msgr2=0x7f918406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f918406a480 0x7f918406c940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f91980cf270 tx=0x7f9190007a40 comp rx=0 tx=0).stop 2023-12-19T13:33:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 msgr2=0x7f91981736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 0x7f91981736e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c480 tx=0x7f919c00c940 comp rx=0 tx=0).stop 2023-12-19T13:33:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 shutdown_connections 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f918406a480 0x7f918406c940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91980cb330 0x7f9198044600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9198042ac0 0x7f91980cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 --2- 172.21.15.6:0/883885759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91980072b0 0x7f91981736e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 >> 172.21.15.6:0/883885759 conn(0x7f91980432a0 msgr2=0x7f91980c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 shutdown_connections 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.679+0000 7f91a825f640 1 -- 172.21.15.6:0/883885759 wait complete. 2023-12-19T13:33:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.681+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faf841e4460 con 0x7faf840b7ac0 2023-12-19T13:33:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.681+0000 7faf6b7fe640 1 -- 172.21.15.6:0/1605806839 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf841e4460 con 0x7faf840b7ac0 2023-12-19T13:33:15.683 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-12-19T13:33:15.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.683+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc39c005380 con 0x7fc39c0cfac0 2023-12-19T13:33:15.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7fc392ffd640 1 -- 172.21.15.6:0/116235660 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc394017090 con 0x7fc39c0cfac0 2023-12-19T13:33:15.686 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-12-19T13:33:15.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-12-19T13:33:15.687 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7faf7006a430 msgr2=0x7faf7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7faf7006a430 0x7faf7006c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf7c007ed0 tx=0x7faf7c007e60 comp rx=0 tx=0).stop 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 msgr2=0x7faf8414daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 0x7faf8414daf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c450 tx=0x7faf7400c910 comp rx=0 tx=0).stop 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 shutdown_connections 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7faf7006a430 0x7faf7006c8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b91d0 0x7faf84143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840b8ac0 0x7faf841e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 --2- 172.21.15.6:0/1605806839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf840b7ac0 0x7faf8414daf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.684+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 >> 172.21.15.6:0/1605806839 conn(0x7faf8406b690 msgr2=0x7faf840bea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.685+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 shutdown_connections 2023-12-19T13:33:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.685+0000 7faf89226640 1 -- 172.21.15.6:0/1605806839 wait complete. 2023-12-19T13:33:15.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc38406a480 msgr2=0x7fc38406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc38406a480 0x7fc38406c940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3a402c8b0 tx=0x7fc3a40b3040 comp rx=0 tx=0).stop 2023-12-19T13:33:15.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0cfac0 msgr2=0x7fc39c0d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0cfac0 0x7fc39c0d5c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e3e0 tx=0x7fc3940097a0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 shutdown_connections 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc38406a480 0x7fc38406c940 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39c0cfac0 0x7fc39c0d5c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c0d8160 0x7fc39c0d5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 --2- 172.21.15.6:0/116235660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c003970 0x7fc39c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 >> 172.21.15.6:0/116235660 conn(0x7fc39c005ec0 msgr2=0x7fc39c005590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 shutdown_connections 2023-12-19T13:33:15.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.686+0000 7fc3a359e640 1 -- 172.21.15.6:0/116235660 wait complete. 2023-12-19T13:33:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.688+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f72580c92b0 con 0x7f7258007f70 2023-12-19T13:33:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.688+0000 7f725cff9640 1 -- 172.21.15.6:0/2096335248 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f724c079400 con 0x7f7258007f70 2023-12-19T13:33:15.691 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-12-19T13:33:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f724406a500 msgr2=0x7f724406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f724406a500 0x7f724406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f72540015a0 tx=0x7f72540078b0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 msgr2=0x7f72580c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 0x7f72580c7ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097d0 tx=0x7f724c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 shutdown_connections 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f724406a500 0x7f724406c9c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72580d9250 0x7f72580c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7258007f70 0x7f72580c7ee0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 --2- 172.21.15.6:0/2096335248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7258007860 0x7f7258041e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.691+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 >> 172.21.15.6:0/2096335248 conn(0x7f7258006b00 msgr2=0x7f72580ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.692+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 shutdown_connections 2023-12-19T13:33:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.692+0000 7f7265749640 1 -- 172.21.15.6:0/2096335248 wait complete. 2023-12-19T13:33:15.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-19T13:33:15.696 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-12-19T13:33:15.701 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-12-19T13:33:15.702 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-12-19T13:33:15.707 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:15.707 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T13:33:15.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:33:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.850+0000 7f4003b43640 1 Processor -- start 2023-12-19T13:33:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f4003b43640 1 -- start start 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f4003b43640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ffc0ba3a0 0x7f3ffc06f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f4003b43640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc14ca90 0x7f3ffc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f4003b43640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0ba780 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f4003b43640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc06f900 con 0x7f3ffc0ba3a0 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f4003b43640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc14c600 con 0x7f3ffc14ca90 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f40018df640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ffc0ba3a0 0x7f3ffc06f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f40018df640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ffc0ba3a0 0x7f3ffc06f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34778/0 (socket says 172.21.15.6:34778) 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.851+0000 7f40018df640 1 -- 172.21.15.6:0/1554812601 learned_addr learned my addr 172.21.15.6:0/1554812601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40010de640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc14ca90 0x7f3ffc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40018df640 1 -- 172.21.15.6:0/1554812601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc14ca90 msgr2=0x7f3ffc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40018df640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc14ca90 0x7f3ffc06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40018df640 1 -- 172.21.15.6:0/1554812601 >> v1:172.21.15.89:6789/0 conn(0x7f3ffc0b46e0 legacy=0x7f3ffc0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40018df640 1 -- 172.21.15.6:0/1554812601 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc14bfb0 con 0x7f3ffc0ba3a0 2023-12-19T13:33:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40010de640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc14ca90 0x7f3ffc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:15.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.852+0000 7f40018df640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0ba3a0 0x7f3ffc06f230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009870 tx=0x7f3ff802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9ae7971d4adfef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f40008dd640 1 -- 172.21.15.6:0/1554812601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8031640 con 0x7f3ffc0ba3a0 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f40008dd640 1 -- 172.21.15.6:0/1554812601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80317a0 con 0x7f3ffc0ba3a0 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f40008dd640 1 -- 172.21.15.6:0/1554812601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8031b30 con 0x7f3ffc0ba3a0 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 -- 172.21.15.6:0/1554812601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0ba3a0 msgr2=0x7f3ffc06f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0ba3a0 0x7f3ffc06f230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009870 tx=0x7f3ff802b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 -- 172.21.15.6:0/1554812601 shutdown_connections 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc14ca90 0x7f3ffc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 --2- 172.21.15.6:0/1554812601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0ba3a0 0x7f3ffc06f230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 -- 172.21.15.6:0/1554812601 >> 172.21.15.6:0/1554812601 conn(0x7f3ffc0bac30 msgr2=0x7f3ffc0bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 -- 172.21.15.6:0/1554812601 shutdown_connections 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.853+0000 7f4003b43640 1 -- 172.21.15.6:0/1554812601 wait complete. 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.854+0000 7f4003b43640 1 Processor -- start 2023-12-19T13:33:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.854+0000 7f4003b43640 1 -- start start 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f4003b43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 0x7f3ffc147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f4003b43640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc0ba3a0 0x7f3ffc143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f4003b43640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ffc14ca90 0x7f3ffc1e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f4003b43640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc148050 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f4003b43640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc143520 con 0x7f3ffc14ca90 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f4003b43640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc144a20 con 0x7f3ffc0ba3a0 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 0x7f3ffc147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 0x7f3ffc147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34780/0 (socket says 172.21.15.6:34780) 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 -- 172.21.15.6:0/3287915023 learned_addr learned my addr 172.21.15.6:0/3287915023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40020e0640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ffc14ca90 0x7f3ffc1e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40010de640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc0ba3a0 0x7f3ffc143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 -- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc0ba3a0 msgr2=0x7f3ffc143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc0ba3a0 0x7f3ffc143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 -- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ffc14ca90 msgr2=0x7f3ffc1e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ffc14ca90 0x7f3ffc1e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 -- 172.21.15.6:0/3287915023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80094d0 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.855+0000 7f40018df640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 0x7f3ffc147b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8000c00 tx=0x7f3ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.856+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff803ac60 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.856+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff803ade0 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.856+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc144330 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.856+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8044630 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.856+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc148230 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.857+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc073a40 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.857+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ff802f050 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.858+0000 7f3ff27fc640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3fe006a430 0x7f3fe006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.858+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff80aa900 con 0x7f3ffc0b46e0 2023-12-19T13:33:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.858+0000 7f40010de640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3fe006a430 0x7f3fe006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.858+0000 7f40010de640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3fe006a430 0x7f3fe006c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0bb080 tx=0x7f3fec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:15.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:15.862+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ff8076060 con 0x7f3ffc0b46e0 2023-12-19T13:33:16.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.036+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ffc0b5260 con 0x7f3fe006a430 2023-12-19T13:33:16.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.044+0000 7f3ff27fc640 1 -- 172.21.15.6:0/3287915023 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264549 (secure 0 0 0) 0x7f3fec00c040 con 0x7f3fe006a430 2023-12-19T13:33:16.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T13:33:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3fe006a430 msgr2=0x7f3fe006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3fe006a430 0x7f3fe006c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0bb080 tx=0x7f3fec008040 comp rx=0 tx=0).stop 2023-12-19T13:33:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 msgr2=0x7f3ffc147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 0x7f3ffc147b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8000c00 tx=0x7f3ff80046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 shutdown_connections 2023-12-19T13:33:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3fe006a430 0x7f3fe006c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ffc14ca90 0x7f3ffc1e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ffc0ba3a0 0x7f3ffc143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 --2- 172.21.15.6:0/3287915023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc0b46e0 0x7f3ffc147b10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 >> 172.21.15.6:0/3287915023 conn(0x7f3ffc0bac30 msgr2=0x7f3ffc14a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 shutdown_connections 2023-12-19T13:33:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.047+0000 7f4003b43640 1 -- 172.21.15.6:0/3287915023 wait complete. 2023-12-19T13:33:16.061 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-19T13:33:15.952928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002195"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466927+0000","last_change":"2023-12-19T13:33:08.041371+0000","last_active":"2023-12-19T13:33:09.466927+0000","last_peered":"2023-12-19T13:33:09.466927+0000","last_clean":"2023-12-19T13:33:09.466927+0000","last_became_active":"2023-12-19T13:33:08.040678+0000","last_became_peered":"2023-12-19T13:33:08.040678+0000","last_unstale":"2023-12-19T13:33:09.466927+0000","last_undegraded":"2023-12-19T13:33:09.466927+0000","last_fullsized":"2023-12-19T13:33:09.466927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037904+0000","last_change":"2023-12-19T13:33:08.043430+0000","last_active":"2023-12-19T13:33:09.037904+0000","last_peered":"2023-12-19T13:33:09.037904+0000","last_clean":"2023-12-19T13:33:09.037904+0000","last_became_active":"2023-12-19T13:33:08.043199+0000","last_became_peered":"2023-12-19T13:33:08.043199+0000","last_unstale":"2023-12-19T13:33:09.037904+0000","last_undegraded":"2023-12-19T13:33:09.037904+0000","last_fullsized":"2023-12-19T13:33:09.037904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467146+0000","last_change":"2023-12-19T13:33:08.049139+0000","last_active":"2023-12-19T13:33:09.467146+0000","last_peered":"2023-12-19T13:33:09.467146+0000","last_clean":"2023-12-19T13:33:09.467146+0000","last_became_active":"2023-12-19T13:33:08.048824+0000","last_became_peered":"2023-12-19T13:33:08.048824+0000","last_unstale":"2023-12-19T13:33:09.467146+0000","last_undegraded":"2023-12-19T13:33:09.467146+0000","last_fullsized":"2023-12-19T13:33:09.467146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:27.092015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466903+0000","last_change":"2023-12-19T13:33:08.058348+0000","last_active":"2023-12-19T13:33:09.466903+0000","last_peered":"2023-12-19T13:33:09.466903+0000","last_clean":"2023-12-19T13:33:09.466903+0000","last_became_active":"2023-12-19T13:33:08.058068+0000","last_became_peered":"2023-12-19T13:33:08.058068+0000","last_unstale":"2023-12-19T13:33:09.466903+0000","last_undegraded":"2023-12-19T13:33:09.466903+0000","last_fullsized":"2023-12-19T13:33:09.466903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:09.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466535+0000","last_change":"2023-12-19T13:33:08.050316+0000","last_active":"2023-12-19T13:33:09.466535+0000","last_peered":"2023-12-19T13:33:09.466535+0000","last_clean":"2023-12-19T13:33:09.466535+0000","last_became_active":"2023-12-19T13:33:08.050049+0000","last_became_peered":"2023-12-19T13:33:08.050049+0000","last_unstale":"2023-12-19T13:33:09.466535+0000","last_undegraded":"2023-12-19T13:33:09.466535+0000","last_fullsized":"2023-12-19T13:33:09.466535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466400+0000","last_change":"2023-12-19T13:33:08.052140+0000","last_active":"2023-12-19T13:33:09.466400+0000","last_peered":"2023-12-19T13:33:09.466400+0000","last_clean":"2023-12-19T13:33:09.466400+0000","last_became_active":"2023-12-19T13:33:08.051880+0000","last_became_peered":"2023-12-19T13:33:08.051880+0000","last_unstale":"2023-12-19T13:33:09.466400+0000","last_undegraded":"2023-12-19T13:33:09.466400+0000","last_fullsized":"2023-12-19T13:33:09.466400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:42:07.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466195+0000","last_change":"2023-12-19T13:33:08.052900+0000","last_active":"2023-12-19T13:33:09.466195+0000","last_peered":"2023-12-19T13:33:09.466195+0000","last_clean":"2023-12-19T13:33:09.466195+0000","last_became_active":"2023-12-19T13:33:08.052646+0000","last_became_peered":"2023-12-19T13:33:08.052646+0000","last_unstale":"2023-12-19T13:33:09.466195+0000","last_undegraded":"2023-12-19T13:33:09.466195+0000","last_fullsized":"2023-12-19T13:33:09.466195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:50:47.691016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466321+0000","last_change":"2023-12-19T13:33:08.055307+0000","last_active":"2023-12-19T13:33:09.466321+0000","last_peered":"2023-12-19T13:33:09.466321+0000","last_clean":"2023-12-19T13:33:09.466321+0000","last_became_active":"2023-12-19T13:33:08.055092+0000","last_became_peered":"2023-12-19T13:33:08.055092+0000","last_unstale":"2023-12-19T13:33:09.466321+0000","last_undegraded":"2023-12-19T13:33:09.466321+0000","last_fullsized":"2023-12-19T13:33:09.466321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467034+0000","last_change":"2023-12-19T13:33:08.052567+0000","last_active":"2023-12-19T13:33:09.467034+0000","last_peered":"2023-12-19T13:33:09.467034+0000","last_clean":"2023-12-19T13:33:09.467034+0000","last_became_active":"2023-12-19T13:33:08.052171+0000","last_became_peered":"2023-12-19T13:33:08.052171+0000","last_unstale":"2023-12-19T13:33:09.467034+0000","last_undegraded":"2023-12-19T13:33:09.467034+0000","last_fullsized":"2023-12-19T13:33:09.467034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:42:07.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039444+0000","last_change":"2023-12-19T13:33:08.056053+0000","last_active":"2023-12-19T13:33:09.039444+0000","last_peered":"2023-12-19T13:33:09.039444+0000","last_clean":"2023-12-19T13:33:09.039444+0000","last_became_active":"2023-12-19T13:33:08.055787+0000","last_became_peered":"2023-12-19T13:33:08.055787+0000","last_unstale":"2023-12-19T13:33:09.039444+0000","last_undegraded":"2023-12-19T13:33:09.039444+0000","last_fullsized":"2023-12-19T13:33:09.039444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039047+0000","last_change":"2023-12-19T13:33:08.056109+0000","last_active":"2023-12-19T13:33:09.039047+0000","last_peered":"2023-12-19T13:33:09.039047+0000","last_clean":"2023-12-19T13:33:09.039047+0000","last_became_active":"2023-12-19T13:33:08.055845+0000","last_became_peered":"2023-12-19T13:33:08.055845+0000","last_unstale":"2023-12-19T13:33:09.039047+0000","last_undegraded":"2023-12-19T13:33:09.039047+0000","last_fullsized":"2023-12-19T13:33:09.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039467+0000","last_change":"2023-12-19T13:33:08.042537+0000","last_active":"2023-12-19T13:33:09.039467+0000","last_peered":"2023-12-19T13:33:09.039467+0000","last_clean":"2023-12-19T13:33:09.039467+0000","last_became_active":"2023-12-19T13:33:08.042257+0000","last_became_peered":"2023-12-19T13:33:08.042257+0000","last_unstale":"2023-12-19T13:33:09.039467+0000","last_undegraded":"2023-12-19T13:33:09.039467+0000","last_fullsized":"2023-12-19T13:33:09.039467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:33.372229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466544+0000","last_change":"2023-12-19T13:33:08.043899+0000","last_active":"2023-12-19T13:33:09.466544+0000","last_peered":"2023-12-19T13:33:09.466544+0000","last_clean":"2023-12-19T13:33:09.466544+0000","last_became_active":"2023-12-19T13:33:08.043653+0000","last_became_peered":"2023-12-19T13:33:08.043653+0000","last_unstale":"2023-12-19T13:33:09.466544+0000","last_undegraded":"2023-12-19T13:33:09.466544+0000","last_fullsized":"2023-12-19T13:33:09.466544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466915+0000","last_change":"2023-12-19T13:33:08.044597+0000","last_active":"2023-12-19T13:33:09.466915+0000","last_peered":"2023-12-19T13:33:09.466915+0000","last_clean":"2023-12-19T13:33:09.466915+0000","last_became_active":"2023-12-19T13:33:08.044327+0000","last_became_peered":"2023-12-19T13:33:08.044327+0000","last_unstale":"2023-12-19T13:33:09.466915+0000","last_undegraded":"2023-12-19T13:33:09.466915+0000","last_fullsized":"2023-12-19T13:33:09.466915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037792+0000","last_change":"2023-12-19T13:33:08.045469+0000","last_active":"2023-12-19T13:33:09.037792+0000","last_peered":"2023-12-19T13:33:09.037792+0000","last_clean":"2023-12-19T13:33:09.037792+0000","last_became_active":"2023-12-19T13:33:08.045205+0000","last_became_peered":"2023-12-19T13:33:08.045205+0000","last_unstale":"2023-12-19T13:33:09.037792+0000","last_undegraded":"2023-12-19T13:33:09.037792+0000","last_fullsized":"2023-12-19T13:33:09.037792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466140+0000","last_change":"2023-12-19T13:33:08.053422+0000","last_active":"2023-12-19T13:33:09.466140+0000","last_peered":"2023-12-19T13:33:09.466140+0000","last_clean":"2023-12-19T13:33:09.466140+0000","last_became_active":"2023-12-19T13:33:08.053139+0000","last_became_peered":"2023-12-19T13:33:08.053139+0000","last_unstale":"2023-12-19T13:33:09.466140+0000","last_undegraded":"2023-12-19T13:33:09.466140+0000","last_fullsized":"2023-12-19T13:33:09.466140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:46.064148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467005+0000","last_change":"2023-12-19T13:33:08.057816+0000","last_active":"2023-12-19T13:33:09.467005+0000","last_peered":"2023-12-19T13:33:09.467005+0000","last_clean":"2023-12-19T13:33:09.467005+0000","last_became_active":"2023-12-19T13:33:08.057561+0000","last_became_peered":"2023-12-19T13:33:08.057561+0000","last_unstale":"2023-12-19T13:33:09.467005+0000","last_undegraded":"2023-12-19T13:33:09.467005+0000","last_fullsized":"2023-12-19T13:33:09.467005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466452+0000","last_change":"2023-12-19T13:33:08.041795+0000","last_active":"2023-12-19T13:33:09.466452+0000","last_peered":"2023-12-19T13:33:09.466452+0000","last_clean":"2023-12-19T13:33:09.466452+0000","last_became_active":"2023-12-19T13:33:08.041545+0000","last_became_peered":"2023-12-19T13:33:08.041545+0000","last_unstale":"2023-12-19T13:33:09.466452+0000","last_undegraded":"2023-12-19T13:33:09.466452+0000","last_fullsized":"2023-12-19T13:33:09.466452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:33.372229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467153+0000","last_change":"2023-12-19T13:33:08.049871+0000","last_active":"2023-12-19T13:33:09.467153+0000","last_peered":"2023-12-19T13:33:09.467153+0000","last_clean":"2023-12-19T13:33:09.467153+0000","last_became_active":"2023-12-19T13:33:08.049592+0000","last_became_peered":"2023-12-19T13:33:08.049592+0000","last_unstale":"2023-12-19T13:33:09.467153+0000","last_undegraded":"2023-12-19T13:33:09.467153+0000","last_fullsized":"2023-12-19T13:33:09.467153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039359+0000","last_change":"2023-12-19T13:33:08.046648+0000","last_active":"2023-12-19T13:33:09.039359+0000","last_peered":"2023-12-19T13:33:09.039359+0000","last_clean":"2023-12-19T13:33:09.039359+0000","last_became_active":"2023-12-19T13:33:08.046365+0000","last_became_peered":"2023-12-19T13:33:08.046365+0000","last_unstale":"2023-12-19T13:33:09.039359+0000","last_undegraded":"2023-12-19T13:33:09.039359+0000","last_fullsized":"2023-12-19T13:33:09.039359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467090+0000","last_change":"2023-12-19T13:33:08.050719+0000","last_active":"2023-12-19T13:33:09.467090+0000","last_peered":"2023-12-19T13:33:09.467090+0000","last_clean":"2023-12-19T13:33:09.467090+0000","last_became_active":"2023-12-19T13:33:08.050479+0000","last_became_peered":"2023-12-19T13:33:08.050479+0000","last_unstale":"2023-12-19T13:33:09.467090+0000","last_undegraded":"2023-12-19T13:33:09.467090+0000","last_fullsized":"2023-12-19T13:33:09.467090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466507+0000","last_change":"2023-12-19T13:33:08.056711+0000","last_active":"2023-12-19T13:33:09.466507+0000","last_peered":"2023-12-19T13:33:09.466507+0000","last_clean":"2023-12-19T13:33:09.466507+0000","last_became_active":"2023-12-19T13:33:08.055926+0000","last_became_peered":"2023-12-19T13:33:08.055926+0000","last_unstale":"2023-12-19T13:33:09.466507+0000","last_undegraded":"2023-12-19T13:33:09.466507+0000","last_fullsized":"2023-12-19T13:33:09.466507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466502+0000","last_change":"2023-12-19T13:33:08.045737+0000","last_active":"2023-12-19T13:33:09.466502+0000","last_peered":"2023-12-19T13:33:09.466502+0000","last_clean":"2023-12-19T13:33:09.466502+0000","last_became_active":"2023-12-19T13:33:08.045342+0000","last_became_peered":"2023-12-19T13:33:08.045342+0000","last_unstale":"2023-12-19T13:33:09.466502+0000","last_undegraded":"2023-12-19T13:33:09.466502+0000","last_fullsized":"2023-12-19T13:33:09.466502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466274+0000","last_change":"2023-12-19T13:33:08.057789+0000","last_active":"2023-12-19T13:33:09.466274+0000","last_peered":"2023-12-19T13:33:09.466274+0000","last_clean":"2023-12-19T13:33:09.466274+0000","last_became_active":"2023-12-19T13:33:08.057533+0000","last_became_peered":"2023-12-19T13:33:08.057533+0000","last_unstale":"2023-12-19T13:33:09.466274+0000","last_undegraded":"2023-12-19T13:33:09.466274+0000","last_fullsized":"2023-12-19T13:33:09.466274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:08:01.224172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466784+0000","last_change":"2023-12-19T13:33:08.047959+0000","last_active":"2023-12-19T13:33:09.466784+0000","last_peered":"2023-12-19T13:33:09.466784+0000","last_clean":"2023-12-19T13:33:09.466784+0000","last_became_active":"2023-12-19T13:33:08.047597+0000","last_became_peered":"2023-12-19T13:33:08.047597+0000","last_unstale":"2023-12-19T13:33:09.466784+0000","last_undegraded":"2023-12-19T13:33:09.466784+0000","last_fullsized":"2023-12-19T13:33:09.466784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039459+0000","last_change":"2023-12-19T13:33:08.044259+0000","last_active":"2023-12-19T13:33:09.039459+0000","last_peered":"2023-12-19T13:33:09.039459+0000","last_clean":"2023-12-19T13:33:09.039459+0000","last_became_active":"2023-12-19T13:33:08.043702+0000","last_became_peered":"2023-12-19T13:33:08.043702+0000","last_unstale":"2023-12-19T13:33:09.039459+0000","last_undegraded":"2023-12-19T13:33:09.039459+0000","last_fullsized":"2023-12-19T13:33:09.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037888+0000","last_change":"2023-12-19T13:33:08.040797+0000","last_active":"2023-12-19T13:33:09.037888+0000","last_peered":"2023-12-19T13:33:09.037888+0000","last_clean":"2023-12-19T13:33:09.037888+0000","last_became_active":"2023-12-19T13:33:08.040509+0000","last_became_peered":"2023-12-19T13:33:08.040509+0000","last_unstale":"2023-12-19T13:33:09.037888+0000","last_undegraded":"2023-12-19T13:33:09.037888+0000","last_fullsized":"2023-12-19T13:33:09.037888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466911+0000","last_change":"2023-12-19T13:33:08.047963+0000","last_active":"2023-12-19T13:33:09.466911+0000","last_peered":"2023-12-19T13:33:09.466911+0000","last_clean":"2023-12-19T13:33:09.466911+0000","last_became_active":"2023-12-19T13:33:08.047279+0000","last_became_peered":"2023-12-19T13:33:08.047279+0000","last_unstale":"2023-12-19T13:33:09.466911+0000","last_undegraded":"2023-12-19T13:33:09.466911+0000","last_fullsized":"2023-12-19T13:33:09.466911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:27.092015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467135+0000","last_change":"2023-12-19T13:33:08.048816+0000","last_active":"2023-12-19T13:33:09.467135+0000","last_peered":"2023-12-19T13:33:09.467135+0000","last_clean":"2023-12-19T13:33:09.467135+0000","last_became_active":"2023-12-19T13:33:08.044942+0000","last_became_peered":"2023-12-19T13:33:08.044942+0000","last_unstale":"2023-12-19T13:33:09.467135+0000","last_undegraded":"2023-12-19T13:33:09.467135+0000","last_fullsized":"2023-12-19T13:33:09.467135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467033+0000","last_change":"2023-12-19T13:33:08.057063+0000","last_active":"2023-12-19T13:33:09.467033+0000","last_peered":"2023-12-19T13:33:09.467033+0000","last_clean":"2023-12-19T13:33:09.467033+0000","last_became_active":"2023-12-19T13:33:08.056806+0000","last_became_peered":"2023-12-19T13:33:08.056806+0000","last_unstale":"2023-12-19T13:33:09.467033+0000","last_undegraded":"2023-12-19T13:33:09.467033+0000","last_fullsized":"2023-12-19T13:33:09.467033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:05.765112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466207+0000","last_change":"2023-12-19T13:33:08.056055+0000","last_active":"2023-12-19T13:33:09.466207+0000","last_peered":"2023-12-19T13:33:09.466207+0000","last_clean":"2023-12-19T13:33:09.466207+0000","last_became_active":"2023-12-19T13:33:08.055797+0000","last_became_peered":"2023-12-19T13:33:08.055797+0000","last_unstale":"2023-12-19T13:33:09.466207+0000","last_undegraded":"2023-12-19T13:33:09.466207+0000","last_fullsized":"2023-12-19T13:33:09.466207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:52.562074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038687+0000","last_change":"2023-12-19T13:33:08.048418+0000","last_active":"2023-12-19T13:33:09.038687+0000","last_peered":"2023-12-19T13:33:09.038687+0000","last_clean":"2023-12-19T13:33:09.038687+0000","last_became_active":"2023-12-19T13:33:08.048151+0000","last_became_peered":"2023-12-19T13:33:08.048151+0000","last_unstale":"2023-12-19T13:33:09.038687+0000","last_undegraded":"2023-12-19T13:33:09.038687+0000","last_fullsized":"2023-12-19T13:33:09.038687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039686+0000","last_change":"2023-12-19T13:33:08.038978+0000","last_active":"2023-12-19T13:33:09.039686+0000","last_peered":"2023-12-19T13:33:09.039686+0000","last_clean":"2023-12-19T13:33:09.039686+0000","last_became_active":"2023-12-19T13:33:08.038729+0000","last_became_peered":"2023-12-19T13:33:08.038729+0000","last_unstale":"2023-12-19T13:33:09.039686+0000","last_undegraded":"2023-12-19T13:33:09.039686+0000","last_fullsized":"2023-12-19T13:33:09.039686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:14.038723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466660+0000","last_change":"2023-12-19T13:33:07.671519+0000","last_active":"2023-12-19T13:33:09.466660+0000","last_peered":"2023-12-19T13:33:09.466660+0000","last_clean":"2023-12-19T13:33:09.466660+0000","last_became_active":"2023-12-19T13:33:07.671235+0000","last_became_peered":"2023-12-19T13:33:07.671235+0000","last_unstale":"2023-12-19T13:33:09.466660+0000","last_undegraded":"2023-12-19T13:33:09.466660+0000","last_fullsized":"2023-12-19T13:33:09.466660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467228+0000","last_change":"2023-12-19T13:33:08.049297+0000","last_active":"2023-12-19T13:33:09.467228+0000","last_peered":"2023-12-19T13:33:09.467228+0000","last_clean":"2023-12-19T13:33:09.467228+0000","last_became_active":"2023-12-19T13:33:08.049080+0000","last_became_peered":"2023-12-19T13:33:08.049080+0000","last_unstale":"2023-12-19T13:33:09.467228+0000","last_undegraded":"2023-12-19T13:33:09.467228+0000","last_fullsized":"2023-12-19T13:33:09.467228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:00:30.701307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038996+0000","last_change":"2023-12-19T13:33:07.663905+0000","last_active":"2023-12-19T13:33:09.038996+0000","last_peered":"2023-12-19T13:33:09.038996+0000","last_clean":"2023-12-19T13:33:09.038996+0000","last_became_active":"2023-12-19T13:33:07.663563+0000","last_became_peered":"2023-12-19T13:33:07.663563+0000","last_unstale":"2023-12-19T13:33:09.038996+0000","last_undegraded":"2023-12-19T13:33:09.038996+0000","last_fullsized":"2023-12-19T13:33:09.038996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466613+0000","last_change":"2023-12-19T13:33:07.662002+0000","last_active":"2023-12-19T13:33:09.466613+0000","last_peered":"2023-12-19T13:33:09.466613+0000","last_clean":"2023-12-19T13:33:09.466613+0000","last_became_active":"2023-12-19T13:33:07.661666+0000","last_became_peered":"2023-12-19T13:33:07.661666+0000","last_unstale":"2023-12-19T13:33:09.466613+0000","last_undegraded":"2023-12-19T13:33:09.466613+0000","last_fullsized":"2023-12-19T13:33:09.466613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466362+0000","last_change":"2023-12-19T13:33:08.045306+0000","last_active":"2023-12-19T13:33:09.466362+0000","last_peered":"2023-12-19T13:33:09.466362+0000","last_clean":"2023-12-19T13:33:09.466362+0000","last_became_active":"2023-12-19T13:33:08.045039+0000","last_became_peered":"2023-12-19T13:33:08.045039+0000","last_unstale":"2023-12-19T13:33:09.466362+0000","last_undegraded":"2023-12-19T13:33:09.466362+0000","last_fullsized":"2023-12-19T13:33:09.466362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466477+0000","last_change":"2023-12-19T13:33:07.673766+0000","last_active":"2023-12-19T13:33:09.466477+0000","last_peered":"2023-12-19T13:33:09.466477+0000","last_clean":"2023-12-19T13:33:09.466477+0000","last_became_active":"2023-12-19T13:33:07.673463+0000","last_became_peered":"2023-12-19T13:33:07.673463+0000","last_unstale":"2023-12-19T13:33:09.466477+0000","last_undegraded":"2023-12-19T13:33:09.466477+0000","last_fullsized":"2023-12-19T13:33:09.466477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037777+0000","last_change":"2023-12-19T13:33:08.043832+0000","last_active":"2023-12-19T13:33:09.037777+0000","last_peered":"2023-12-19T13:33:09.037777+0000","last_clean":"2023-12-19T13:33:09.037777+0000","last_became_active":"2023-12-19T13:33:08.042167+0000","last_became_peered":"2023-12-19T13:33:08.042167+0000","last_unstale":"2023-12-19T13:33:09.037777+0000","last_undegraded":"2023-12-19T13:33:09.037777+0000","last_fullsized":"2023-12-19T13:33:09.037777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039233+0000","last_change":"2023-12-19T13:33:07.671819+0000","last_active":"2023-12-19T13:33:09.039233+0000","last_peered":"2023-12-19T13:33:09.039233+0000","last_clean":"2023-12-19T13:33:09.039233+0000","last_became_active":"2023-12-19T13:33:07.671550+0000","last_became_peered":"2023-12-19T13:33:07.671550+0000","last_unstale":"2023-12-19T13:33:09.039233+0000","last_undegraded":"2023-12-19T13:33:09.039233+0000","last_fullsized":"2023-12-19T13:33:09.039233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466753+0000","last_change":"2023-12-19T13:33:08.056202+0000","last_active":"2023-12-19T13:33:09.466753+0000","last_peered":"2023-12-19T13:33:09.466753+0000","last_clean":"2023-12-19T13:33:09.466753+0000","last_became_active":"2023-12-19T13:33:08.055954+0000","last_became_peered":"2023-12-19T13:33:08.055954+0000","last_unstale":"2023-12-19T13:33:09.466753+0000","last_undegraded":"2023-12-19T13:33:09.466753+0000","last_fullsized":"2023-12-19T13:33:09.466753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466862+0000","last_change":"2023-12-19T13:33:07.672051+0000","last_active":"2023-12-19T13:33:09.466862+0000","last_peered":"2023-12-19T13:33:09.466862+0000","last_clean":"2023-12-19T13:33:09.466862+0000","last_became_active":"2023-12-19T13:33:07.671460+0000","last_became_peered":"2023-12-19T13:33:07.671460+0000","last_unstale":"2023-12-19T13:33:09.466862+0000","last_undegraded":"2023-12-19T13:33:09.466862+0000","last_fullsized":"2023-12-19T13:33:09.466862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467333+0000","last_change":"2023-12-19T13:33:08.049996+0000","last_active":"2023-12-19T13:33:09.467333+0000","last_peered":"2023-12-19T13:33:09.467333+0000","last_clean":"2023-12-19T13:33:09.467333+0000","last_became_active":"2023-12-19T13:33:08.049731+0000","last_became_peered":"2023-12-19T13:33:08.049731+0000","last_unstale":"2023-12-19T13:33:09.467333+0000","last_undegraded":"2023-12-19T13:33:09.467333+0000","last_fullsized":"2023-12-19T13:33:09.467333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037979+0000","last_change":"2023-12-19T13:33:07.669934+0000","last_active":"2023-12-19T13:33:09.037979+0000","last_peered":"2023-12-19T13:33:09.037979+0000","last_clean":"2023-12-19T13:33:09.037979+0000","last_became_active":"2023-12-19T13:33:07.669396+0000","last_became_peered":"2023-12-19T13:33:07.669396+0000","last_unstale":"2023-12-19T13:33:09.037979+0000","last_undegraded":"2023-12-19T13:33:09.037979+0000","last_fullsized":"2023-12-19T13:33:09.037979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039568+0000","last_change":"2023-12-19T13:33:08.053672+0000","last_active":"2023-12-19T13:33:09.039568+0000","last_peered":"2023-12-19T13:33:09.039568+0000","last_clean":"2023-12-19T13:33:09.039568+0000","last_became_active":"2023-12-19T13:33:08.052055+0000","last_became_peered":"2023-12-19T13:33:08.052055+0000","last_unstale":"2023-12-19T13:33:09.039568+0000","last_undegraded":"2023-12-19T13:33:09.039568+0000","last_fullsized":"2023-12-19T13:33:09.039568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:17:53.430044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039446+0000","last_change":"2023-12-19T13:33:07.666435+0000","last_active":"2023-12-19T13:33:09.039446+0000","last_peered":"2023-12-19T13:33:09.039446+0000","last_clean":"2023-12-19T13:33:09.039446+0000","last_became_active":"2023-12-19T13:33:07.666031+0000","last_became_peered":"2023-12-19T13:33:07.666031+0000","last_unstale":"2023-12-19T13:33:09.039446+0000","last_undegraded":"2023-12-19T13:33:09.039446+0000","last_fullsized":"2023-12-19T13:33:09.039446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466989+0000","last_change":"2023-12-19T13:33:08.046354+0000","last_active":"2023-12-19T13:33:09.466989+0000","last_peered":"2023-12-19T13:33:09.466989+0000","last_clean":"2023-12-19T13:33:09.466989+0000","last_became_active":"2023-12-19T13:33:08.046083+0000","last_became_peered":"2023-12-19T13:33:08.046083+0000","last_unstale":"2023-12-19T13:33:09.466989+0000","last_undegraded":"2023-12-19T13:33:09.466989+0000","last_fullsized":"2023-12-19T13:33:09.466989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467261+0000","last_change":"2023-12-19T13:33:07.666609+0000","last_active":"2023-12-19T13:33:09.467261+0000","last_peered":"2023-12-19T13:33:09.467261+0000","last_clean":"2023-12-19T13:33:09.467261+0000","last_became_active":"2023-12-19T13:33:07.665764+0000","last_became_peered":"2023-12-19T13:33:07.665764+0000","last_unstale":"2023-12-19T13:33:09.467261+0000","last_undegraded":"2023-12-19T13:33:09.467261+0000","last_fullsized":"2023-12-19T13:33:09.467261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466915+0000","last_change":"2023-12-19T13:33:08.051291+0000","last_active":"2023-12-19T13:33:09.466915+0000","last_peered":"2023-12-19T13:33:09.466915+0000","last_clean":"2023-12-19T13:33:09.466915+0000","last_became_active":"2023-12-19T13:33:08.051016+0000","last_became_peered":"2023-12-19T13:33:08.051016+0000","last_unstale":"2023-12-19T13:33:09.466915+0000","last_undegraded":"2023-12-19T13:33:09.466915+0000","last_fullsized":"2023-12-19T13:33:09.466915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466597+0000","last_change":"2023-12-19T13:33:07.675720+0000","last_active":"2023-12-19T13:33:09.466597+0000","last_peered":"2023-12-19T13:33:09.466597+0000","last_clean":"2023-12-19T13:33:09.466597+0000","last_became_active":"2023-12-19T13:33:07.675434+0000","last_became_peered":"2023-12-19T13:33:07.675434+0000","last_unstale":"2023-12-19T13:33:09.466597+0000","last_undegraded":"2023-12-19T13:33:09.466597+0000","last_fullsized":"2023-12-19T13:33:09.466597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466680+0000","last_change":"2023-12-19T13:33:08.051519+0000","last_active":"2023-12-19T13:33:09.466680+0000","last_peered":"2023-12-19T13:33:09.466680+0000","last_clean":"2023-12-19T13:33:09.466680+0000","last_became_active":"2023-12-19T13:33:08.050189+0000","last_became_peered":"2023-12-19T13:33:08.050189+0000","last_unstale":"2023-12-19T13:33:09.466680+0000","last_undegraded":"2023-12-19T13:33:09.466680+0000","last_fullsized":"2023-12-19T13:33:09.466680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038751+0000","last_change":"2023-12-19T13:33:07.663565+0000","last_active":"2023-12-19T13:33:09.038751+0000","last_peered":"2023-12-19T13:33:09.038751+0000","last_clean":"2023-12-19T13:33:09.038751+0000","last_became_active":"2023-12-19T13:33:07.663174+0000","last_became_peered":"2023-12-19T13:33:07.663174+0000","last_unstale":"2023-12-19T13:33:09.038751+0000","last_undegraded":"2023-12-19T13:33:09.038751+0000","last_fullsized":"2023-12-19T13:33:09.038751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038815+0000","last_change":"2023-12-19T13:33:08.048060+0000","last_active":"2023-12-19T13:33:09.038815+0000","last_peered":"2023-12-19T13:33:09.038815+0000","last_clean":"2023-12-19T13:33:09.038815+0000","last_became_active":"2023-12-19T13:33:08.047791+0000","last_became_peered":"2023-12-19T13:33:08.047791+0000","last_unstale":"2023-12-19T13:33:09.038815+0000","last_undegraded":"2023-12-19T13:33:09.038815+0000","last_fullsized":"2023-12-19T13:33:09.038815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.465958+0000","last_change":"2023-12-19T13:33:07.665027+0000","last_active":"2023-12-19T13:33:09.465958+0000","last_peered":"2023-12-19T13:33:09.465958+0000","last_clean":"2023-12-19T13:33:09.465958+0000","last_became_active":"2023-12-19T13:33:07.664706+0000","last_became_peered":"2023-12-19T13:33:07.664706+0000","last_unstale":"2023-12-19T13:33:09.465958+0000","last_undegraded":"2023-12-19T13:33:09.465958+0000","last_fullsized":"2023-12-19T13:33:09.465958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466823+0000","last_change":"2023-12-19T13:33:08.052125+0000","last_active":"2023-12-19T13:33:09.466823+0000","last_peered":"2023-12-19T13:33:09.466823+0000","last_clean":"2023-12-19T13:33:09.466823+0000","last_became_active":"2023-12-19T13:33:08.051831+0000","last_became_peered":"2023-12-19T13:33:08.051831+0000","last_unstale":"2023-12-19T13:33:09.466823+0000","last_undegraded":"2023-12-19T13:33:09.466823+0000","last_fullsized":"2023-12-19T13:33:09.466823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:05.765112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039227+0000","last_change":"2023-12-19T13:33:07.668053+0000","last_active":"2023-12-19T13:33:09.039227+0000","last_peered":"2023-12-19T13:33:09.039227+0000","last_clean":"2023-12-19T13:33:09.039227+0000","last_became_active":"2023-12-19T13:33:07.667791+0000","last_became_peered":"2023-12-19T13:33:07.667791+0000","last_unstale":"2023-12-19T13:33:09.039227+0000","last_undegraded":"2023-12-19T13:33:09.039227+0000","last_fullsized":"2023-12-19T13:33:09.039227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:47.342437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466698+0000","last_change":"2023-12-19T13:33:08.049950+0000","last_active":"2023-12-19T13:33:09.466698+0000","last_peered":"2023-12-19T13:33:09.466698+0000","last_clean":"2023-12-19T13:33:09.466698+0000","last_became_active":"2023-12-19T13:33:08.049688+0000","last_became_peered":"2023-12-19T13:33:08.049688+0000","last_unstale":"2023-12-19T13:33:09.466698+0000","last_undegraded":"2023-12-19T13:33:09.466698+0000","last_fullsized":"2023-12-19T13:33:09.466698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:05.364189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466401+0000","last_change":"2023-12-19T13:33:07.671312+0000","last_active":"2023-12-19T13:33:09.466401+0000","last_peered":"2023-12-19T13:33:09.466401+0000","last_clean":"2023-12-19T13:33:09.466401+0000","last_became_active":"2023-12-19T13:33:07.670997+0000","last_became_peered":"2023-12-19T13:33:07.670997+0000","last_unstale":"2023-12-19T13:33:09.466401+0000","last_undegraded":"2023-12-19T13:33:09.466401+0000","last_fullsized":"2023-12-19T13:33:09.466401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467114+0000","last_change":"2023-12-19T13:33:08.052491+0000","last_active":"2023-12-19T13:33:09.467114+0000","last_peered":"2023-12-19T13:33:09.467114+0000","last_clean":"2023-12-19T13:33:09.467114+0000","last_became_active":"2023-12-19T13:33:08.050405+0000","last_became_peered":"2023-12-19T13:33:08.050405+0000","last_unstale":"2023-12-19T13:33:09.467114+0000","last_undegraded":"2023-12-19T13:33:09.467114+0000","last_fullsized":"2023-12-19T13:33:09.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:09.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038055+0000","last_change":"2023-12-19T13:33:07.673634+0000","last_active":"2023-12-19T13:33:09.038055+0000","last_peered":"2023-12-19T13:33:09.038055+0000","last_clean":"2023-12-19T13:33:09.038055+0000","last_became_active":"2023-12-19T13:33:07.673391+0000","last_became_peered":"2023-12-19T13:33:07.673391+0000","last_unstale":"2023-12-19T13:33:09.038055+0000","last_undegraded":"2023-12-19T13:33:09.038055+0000","last_fullsized":"2023-12-19T13:33:09.038055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466616+0000","last_change":"2023-12-19T13:33:08.057771+0000","last_active":"2023-12-19T13:33:09.466616+0000","last_peered":"2023-12-19T13:33:09.466616+0000","last_clean":"2023-12-19T13:33:09.466616+0000","last_became_active":"2023-12-19T13:33:08.057153+0000","last_became_peered":"2023-12-19T13:33:08.057153+0000","last_unstale":"2023-12-19T13:33:09.466616+0000","last_undegraded":"2023-12-19T13:33:09.466616+0000","last_fullsized":"2023-12-19T13:33:09.466616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:05.364189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466126+0000","last_change":"2023-12-19T13:33:07.670225+0000","last_active":"2023-12-19T13:33:09.466126+0000","last_peered":"2023-12-19T13:33:09.466126+0000","last_clean":"2023-12-19T13:33:09.466126+0000","last_became_active":"2023-12-19T13:33:07.669851+0000","last_became_peered":"2023-12-19T13:33:07.669851+0000","last_unstale":"2023-12-19T13:33:09.466126+0000","last_undegraded":"2023-12-19T13:33:09.466126+0000","last_fullsized":"2023-12-19T13:33:09.466126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467033+0000","last_change":"2023-12-19T13:33:08.056812+0000","last_active":"2023-12-19T13:33:09.467033+0000","last_peered":"2023-12-19T13:33:09.467033+0000","last_clean":"2023-12-19T13:33:09.467033+0000","last_became_active":"2023-12-19T13:33:08.056390+0000","last_became_peered":"2023-12-19T13:33:08.056390+0000","last_unstale":"2023-12-19T13:33:09.467033+0000","last_undegraded":"2023-12-19T13:33:09.467033+0000","last_fullsized":"2023-12-19T13:33:09.467033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:46.064148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:33:08.037035+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T13:33:08.037035+0000","last_peered":"2023-12-19T13:33:08.037035+0000","last_clean":"2023-12-19T13:33:08.037035+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T13:33:08.037035+0000","last_undegraded":"2023-12-19T13:33:08.037035+0000","last_fullsized":"2023-12-19T13:33:08.037035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466303+0000","last_change":"2023-12-19T13:33:07.669727+0000","last_active":"2023-12-19T13:33:09.466303+0000","last_peered":"2023-12-19T13:33:09.466303+0000","last_clean":"2023-12-19T13:33:09.466303+0000","last_became_active":"2023-12-19T13:33:07.669402+0000","last_became_peered":"2023-12-19T13:33:07.669402+0000","last_unstale":"2023-12-19T13:33:09.466303+0000","last_undegraded":"2023-12-19T13:33:09.466303+0000","last_fullsized":"2023-12-19T13:33:09.466303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466755+0000","last_change":"2023-12-19T13:33:08.053509+0000","last_active":"2023-12-19T13:33:09.466755+0000","last_peered":"2023-12-19T13:33:09.466755+0000","last_clean":"2023-12-19T13:33:09.466755+0000","last_became_active":"2023-12-19T13:33:08.053242+0000","last_became_peered":"2023-12-19T13:33:08.053242+0000","last_unstale":"2023-12-19T13:33:09.466755+0000","last_undegraded":"2023-12-19T13:33:09.466755+0000","last_fullsized":"2023-12-19T13:33:09.466755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466114+0000","last_change":"2023-12-19T13:33:07.672010+0000","last_active":"2023-12-19T13:33:09.466114+0000","last_peered":"2023-12-19T13:33:09.466114+0000","last_clean":"2023-12-19T13:33:09.466114+0000","last_became_active":"2023-12-19T13:33:07.671753+0000","last_became_peered":"2023-12-19T13:33:07.671753+0000","last_unstale":"2023-12-19T13:33:09.466114+0000","last_undegraded":"2023-12-19T13:33:09.466114+0000","last_fullsized":"2023-12-19T13:33:09.466114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:32.366813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466752+0000","last_change":"2023-12-19T13:33:08.046756+0000","last_active":"2023-12-19T13:33:09.466752+0000","last_peered":"2023-12-19T13:33:09.466752+0000","last_clean":"2023-12-19T13:33:09.466752+0000","last_became_active":"2023-12-19T13:33:08.046513+0000","last_became_peered":"2023-12-19T13:33:08.046513+0000","last_unstale":"2023-12-19T13:33:09.466752+0000","last_undegraded":"2023-12-19T13:33:09.466752+0000","last_fullsized":"2023-12-19T13:33:09.466752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466102+0000","last_change":"2023-12-19T13:33:07.666893+0000","last_active":"2023-12-19T13:33:09.466102+0000","last_peered":"2023-12-19T13:33:09.466102+0000","last_clean":"2023-12-19T13:33:09.466102+0000","last_became_active":"2023-12-19T13:33:07.666570+0000","last_became_peered":"2023-12-19T13:33:07.666570+0000","last_unstale":"2023-12-19T13:33:09.466102+0000","last_undegraded":"2023-12-19T13:33:09.466102+0000","last_fullsized":"2023-12-19T13:33:09.466102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037791+0000","last_change":"2023-12-19T13:33:08.044537+0000","last_active":"2023-12-19T13:33:09.037791+0000","last_peered":"2023-12-19T13:33:09.037791+0000","last_clean":"2023-12-19T13:33:09.037791+0000","last_became_active":"2023-12-19T13:33:08.043564+0000","last_became_peered":"2023-12-19T13:33:08.043564+0000","last_unstale":"2023-12-19T13:33:09.037791+0000","last_undegraded":"2023-12-19T13:33:09.037791+0000","last_fullsized":"2023-12-19T13:33:09.037791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466693+0000","last_change":"2023-12-19T13:33:07.671346+0000","last_active":"2023-12-19T13:33:09.466693+0000","last_peered":"2023-12-19T13:33:09.466693+0000","last_clean":"2023-12-19T13:33:09.466693+0000","last_became_active":"2023-12-19T13:33:07.670835+0000","last_became_peered":"2023-12-19T13:33:07.670835+0000","last_unstale":"2023-12-19T13:33:09.466693+0000","last_undegraded":"2023-12-19T13:33:09.466693+0000","last_fullsized":"2023-12-19T13:33:09.466693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039595+0000","last_change":"2023-12-19T13:33:08.052676+0000","last_active":"2023-12-19T13:33:09.039595+0000","last_peered":"2023-12-19T13:33:09.039595+0000","last_clean":"2023-12-19T13:33:09.039595+0000","last_became_active":"2023-12-19T13:33:08.052415+0000","last_became_peered":"2023-12-19T13:33:08.052415+0000","last_unstale":"2023-12-19T13:33:09.039595+0000","last_undegraded":"2023-12-19T13:33:09.039595+0000","last_fullsized":"2023-12-19T13:33:09.039595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:52.562074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037987+0000","last_change":"2023-12-19T13:33:07.668666+0000","last_active":"2023-12-19T13:33:09.037987+0000","last_peered":"2023-12-19T13:33:09.037987+0000","last_clean":"2023-12-19T13:33:09.037987+0000","last_became_active":"2023-12-19T13:33:07.668398+0000","last_became_peered":"2023-12-19T13:33:07.668398+0000","last_unstale":"2023-12-19T13:33:09.037987+0000","last_undegraded":"2023-12-19T13:33:09.037987+0000","last_fullsized":"2023-12-19T13:33:09.037987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467057+0000","last_change":"2023-12-19T13:33:08.058068+0000","last_active":"2023-12-19T13:33:09.467057+0000","last_peered":"2023-12-19T13:33:09.467057+0000","last_clean":"2023-12-19T13:33:09.467057+0000","last_became_active":"2023-12-19T13:33:08.057740+0000","last_became_peered":"2023-12-19T13:33:08.057740+0000","last_unstale":"2023-12-19T13:33:09.467057+0000","last_undegraded":"2023-12-19T13:33:09.467057+0000","last_fullsized":"2023-12-19T13:33:09.467057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467178+0000","last_change":"2023-12-19T13:33:07.675084+0000","last_active":"2023-12-19T13:33:09.467178+0000","last_peered":"2023-12-19T13:33:09.467178+0000","last_clean":"2023-12-19T13:33:09.467178+0000","last_became_active":"2023-12-19T13:33:07.674840+0000","last_became_peered":"2023-12-19T13:33:07.674840+0000","last_unstale":"2023-12-19T13:33:09.467178+0000","last_undegraded":"2023-12-19T13:33:09.467178+0000","last_fullsized":"2023-12-19T13:33:09.467178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037889+0000","last_change":"2023-12-19T13:33:08.043314+0000","last_active":"2023-12-19T13:33:09.037889+0000","last_peered":"2023-12-19T13:33:09.037889+0000","last_clean":"2023-12-19T13:33:09.037889+0000","last_became_active":"2023-12-19T13:33:08.043051+0000","last_became_peered":"2023-12-19T13:33:08.043051+0000","last_unstale":"2023-12-19T13:33:09.037889+0000","last_undegraded":"2023-12-19T13:33:09.037889+0000","last_fullsized":"2023-12-19T13:33:09.037889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:10.970740+0000","last_change":"2023-12-19T13:33:07.665299+0000","last_active":"2023-12-19T13:33:10.970740+0000","last_peered":"2023-12-19T13:33:10.970740+0000","last_clean":"2023-12-19T13:33:10.970740+0000","last_became_active":"2023-12-19T13:33:07.665030+0000","last_became_peered":"2023-12-19T13:33:07.665030+0000","last_unstale":"2023-12-19T13:33:10.970740+0000","last_undegraded":"2023-12-19T13:33:10.970740+0000","last_fullsized":"2023-12-19T13:33:10.970740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466907+0000","last_change":"2023-12-19T13:33:08.050353+0000","last_active":"2023-12-19T13:33:09.466907+0000","last_peered":"2023-12-19T13:33:09.466907+0000","last_clean":"2023-12-19T13:33:09.466907+0000","last_became_active":"2023-12-19T13:33:08.050051+0000","last_became_peered":"2023-12-19T13:33:08.050051+0000","last_unstale":"2023-12-19T13:33:09.466907+0000","last_undegraded":"2023-12-19T13:33:09.466907+0000","last_fullsized":"2023-12-19T13:33:09.466907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:10.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039345+0000","last_change":"2023-12-19T13:33:07.668359+0000","last_active":"2023-12-19T13:33:09.039345+0000","last_peered":"2023-12-19T13:33:09.039345+0000","last_clean":"2023-12-19T13:33:09.039345+0000","last_became_active":"2023-12-19T13:33:07.668113+0000","last_became_peered":"2023-12-19T13:33:07.668113+0000","last_unstale":"2023-12-19T13:33:09.039345+0000","last_undegraded":"2023-12-19T13:33:09.039345+0000","last_fullsized":"2023-12-19T13:33:09.039345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467364+0000","last_change":"2023-12-19T13:33:08.047035+0000","last_active":"2023-12-19T13:33:09.467364+0000","last_peered":"2023-12-19T13:33:09.467364+0000","last_clean":"2023-12-19T13:33:09.467364+0000","last_became_active":"2023-12-19T13:33:08.045656+0000","last_became_peered":"2023-12-19T13:33:08.045656+0000","last_unstale":"2023-12-19T13:33:09.467364+0000","last_undegraded":"2023-12-19T13:33:09.467364+0000","last_fullsized":"2023-12-19T13:33:09.467364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466112+0000","last_change":"2023-12-19T13:33:07.676027+0000","last_active":"2023-12-19T13:33:09.466112+0000","last_peered":"2023-12-19T13:33:09.466112+0000","last_clean":"2023-12-19T13:33:09.466112+0000","last_became_active":"2023-12-19T13:33:07.675643+0000","last_became_peered":"2023-12-19T13:33:07.675643+0000","last_unstale":"2023-12-19T13:33:09.466112+0000","last_undegraded":"2023-12-19T13:33:09.466112+0000","last_fullsized":"2023-12-19T13:33:09.466112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039707+0000","last_change":"2023-12-19T13:33:08.044642+0000","last_active":"2023-12-19T13:33:09.039707+0000","last_peered":"2023-12-19T13:33:09.039707+0000","last_clean":"2023-12-19T13:33:09.039707+0000","last_became_active":"2023-12-19T13:33:08.044393+0000","last_became_peered":"2023-12-19T13:33:08.044393+0000","last_unstale":"2023-12-19T13:33:09.039707+0000","last_undegraded":"2023-12-19T13:33:09.039707+0000","last_fullsized":"2023-12-19T13:33:09.039707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:13.074479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037873+0000","last_change":"2023-12-19T13:33:07.672222+0000","last_active":"2023-12-19T13:33:09.037873+0000","last_peered":"2023-12-19T13:33:09.037873+0000","last_clean":"2023-12-19T13:33:09.037873+0000","last_became_active":"2023-12-19T13:33:07.671916+0000","last_became_peered":"2023-12-19T13:33:07.671916+0000","last_unstale":"2023-12-19T13:33:09.037873+0000","last_undegraded":"2023-12-19T13:33:09.037873+0000","last_fullsized":"2023-12-19T13:33:09.037873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466479+0000","last_change":"2023-12-19T13:33:08.046213+0000","last_active":"2023-12-19T13:33:09.466479+0000","last_peered":"2023-12-19T13:33:09.466479+0000","last_clean":"2023-12-19T13:33:09.466479+0000","last_became_active":"2023-12-19T13:33:08.045740+0000","last_became_peered":"2023-12-19T13:33:08.045740+0000","last_unstale":"2023-12-19T13:33:09.466479+0000","last_undegraded":"2023-12-19T13:33:09.466479+0000","last_fullsized":"2023-12-19T13:33:09.466479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037969+0000","last_change":"2023-12-19T13:33:07.674107+0000","last_active":"2023-12-19T13:33:09.037969+0000","last_peered":"2023-12-19T13:33:09.037969+0000","last_clean":"2023-12-19T13:33:09.037969+0000","last_became_active":"2023-12-19T13:33:07.673826+0000","last_became_peered":"2023-12-19T13:33:07.673826+0000","last_unstale":"2023-12-19T13:33:09.037969+0000","last_undegraded":"2023-12-19T13:33:09.037969+0000","last_fullsized":"2023-12-19T13:33:09.037969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466593+0000","last_change":"2023-12-19T13:33:08.053691+0000","last_active":"2023-12-19T13:33:09.466593+0000","last_peered":"2023-12-19T13:33:09.466593+0000","last_clean":"2023-12-19T13:33:09.466593+0000","last_became_active":"2023-12-19T13:33:08.052956+0000","last_became_peered":"2023-12-19T13:33:08.052956+0000","last_unstale":"2023-12-19T13:33:09.466593+0000","last_undegraded":"2023-12-19T13:33:09.466593+0000","last_fullsized":"2023-12-19T13:33:09.466593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466990+0000","last_change":"2023-12-19T13:33:07.673744+0000","last_active":"2023-12-19T13:33:09.466990+0000","last_peered":"2023-12-19T13:33:09.466990+0000","last_clean":"2023-12-19T13:33:09.466990+0000","last_became_active":"2023-12-19T13:33:07.673350+0000","last_became_peered":"2023-12-19T13:33:07.673350+0000","last_unstale":"2023-12-19T13:33:09.466990+0000","last_undegraded":"2023-12-19T13:33:09.466990+0000","last_fullsized":"2023-12-19T13:33:09.466990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:51.556658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038917+0000","last_change":"2023-12-19T13:33:08.047155+0000","last_active":"2023-12-19T13:33:09.038917+0000","last_peered":"2023-12-19T13:33:09.038917+0000","last_clean":"2023-12-19T13:33:09.038917+0000","last_became_active":"2023-12-19T13:33:08.046913+0000","last_became_peered":"2023-12-19T13:33:08.046913+0000","last_unstale":"2023-12-19T13:33:09.038917+0000","last_undegraded":"2023-12-19T13:33:09.038917+0000","last_fullsized":"2023-12-19T13:33:09.038917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:00:30.701307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466703+0000","last_change":"2023-12-19T13:33:08.059339+0000","last_active":"2023-12-19T13:33:09.466703+0000","last_peered":"2023-12-19T13:33:09.466703+0000","last_clean":"2023-12-19T13:33:09.466703+0000","last_became_active":"2023-12-19T13:33:08.059075+0000","last_became_peered":"2023-12-19T13:33:08.059075+0000","last_unstale":"2023-12-19T13:33:09.466703+0000","last_undegraded":"2023-12-19T13:33:09.466703+0000","last_fullsized":"2023-12-19T13:33:09.466703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466938+0000","last_change":"2023-12-19T13:33:07.672573+0000","last_active":"2023-12-19T13:33:09.466938+0000","last_peered":"2023-12-19T13:33:09.466938+0000","last_clean":"2023-12-19T13:33:09.466938+0000","last_became_active":"2023-12-19T13:33:07.672300+0000","last_became_peered":"2023-12-19T13:33:07.672300+0000","last_unstale":"2023-12-19T13:33:09.466938+0000","last_undegraded":"2023-12-19T13:33:09.466938+0000","last_fullsized":"2023-12-19T13:33:09.466938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:17:52.424628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466505+0000","last_change":"2023-12-19T13:33:08.059145+0000","last_active":"2023-12-19T13:33:09.466505+0000","last_peered":"2023-12-19T13:33:09.466505+0000","last_clean":"2023-12-19T13:33:09.466505+0000","last_became_active":"2023-12-19T13:33:08.058854+0000","last_became_peered":"2023-12-19T13:33:08.058854+0000","last_unstale":"2023-12-19T13:33:09.466505+0000","last_undegraded":"2023-12-19T13:33:09.466505+0000","last_fullsized":"2023-12-19T13:33:09.466505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467092+0000","last_change":"2023-12-19T13:33:07.670541+0000","last_active":"2023-12-19T13:33:09.467092+0000","last_peered":"2023-12-19T13:33:09.467092+0000","last_clean":"2023-12-19T13:33:09.467092+0000","last_became_active":"2023-12-19T13:33:07.670255+0000","last_became_peered":"2023-12-19T13:33:07.670255+0000","last_unstale":"2023-12-19T13:33:09.467092+0000","last_undegraded":"2023-12-19T13:33:09.467092+0000","last_fullsized":"2023-12-19T13:33:09.467092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467194+0000","last_change":"2023-12-19T13:33:08.056004+0000","last_active":"2023-12-19T13:33:09.467194+0000","last_peered":"2023-12-19T13:33:09.467194+0000","last_clean":"2023-12-19T13:33:09.467194+0000","last_became_active":"2023-12-19T13:33:08.055703+0000","last_became_peered":"2023-12-19T13:33:08.055703+0000","last_unstale":"2023-12-19T13:33:09.467194+0000","last_undegraded":"2023-12-19T13:33:09.467194+0000","last_fullsized":"2023-12-19T13:33:09.467194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467024+0000","last_change":"2023-12-19T13:33:07.675986+0000","last_active":"2023-12-19T13:33:09.467024+0000","last_peered":"2023-12-19T13:33:09.467024+0000","last_clean":"2023-12-19T13:33:09.467024+0000","last_became_active":"2023-12-19T13:33:07.675686+0000","last_became_peered":"2023-12-19T13:33:07.675686+0000","last_unstale":"2023-12-19T13:33:09.467024+0000","last_undegraded":"2023-12-19T13:33:09.467024+0000","last_fullsized":"2023-12-19T13:33:09.467024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466896+0000","last_change":"2023-12-19T13:33:08.045717+0000","last_active":"2023-12-19T13:33:09.466896+0000","last_peered":"2023-12-19T13:33:09.466896+0000","last_clean":"2023-12-19T13:33:09.466896+0000","last_became_active":"2023-12-19T13:33:08.045449+0000","last_became_peered":"2023-12-19T13:33:08.045449+0000","last_unstale":"2023-12-19T13:33:09.466896+0000","last_undegraded":"2023-12-19T13:33:09.466896+0000","last_fullsized":"2023-12-19T13:33:09.466896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467371+0000","last_change":"2023-12-19T13:33:07.673708+0000","last_active":"2023-12-19T13:33:09.467371+0000","last_peered":"2023-12-19T13:33:09.467371+0000","last_clean":"2023-12-19T13:33:09.467371+0000","last_became_active":"2023-12-19T13:33:07.673458+0000","last_became_peered":"2023-12-19T13:33:07.673458+0000","last_unstale":"2023-12-19T13:33:09.467371+0000","last_undegraded":"2023-12-19T13:33:09.467371+0000","last_fullsized":"2023-12-19T13:33:09.467371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T13:33:16.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:33:16.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.204+0000 7f21d6163640 1 Processor -- start 2023-12-19T13:33:16.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.204+0000 7f21d6163640 1 -- start start 2023-12-19T13:33:16.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21d6163640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 0x7f21d00b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21d6163640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00bb310 con 0x7f21d006a6d0 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21d6163640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00bf960 con 0x7f21d00ba000 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21d6163640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00bb5b0 con 0x7f21d00ba550 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21cf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f21d006a6d0 0x7f21d014acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56444/0 (socket says 172.21.15.6:56444) 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21cf7fe640 1 -- 172.21.15.6:0/455836693 learned_addr learned my addr 172.21.15.6:0/455836693 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ceffd640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 0x7f21d00b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185502430 0 0) 0x7f21d00bb310 con 0x7f21d006a6d0 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b8003520 con 0x7f21d006a6d0 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735932123 0 0) 0x7f21d00bf960 con 0x7f21d00ba000 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d00bb310 con 0x7f21d00ba000 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703608556 0 0) 0x7f21b8003520 con 0x7f21d006a6d0 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 msgr2=0x7f21d00b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 0x7f21d00b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 >> v1:172.21.15.89:6789/0 conn(0x7f21d00ba000 legacy=0x7f21d01554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00c0120 con 0x7f21d006a6d0 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.205+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f21c0001670 con 0x7f21d006a6d0 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 >> v1:172.21.15.6:6789/0 conn(0x7f21d006a6d0 legacy=0x7f21d014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 0x7f21b8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b8004090 0x7f21b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00bb5b0 con 0x7f21b8004d00 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b800ba60 con 0x7f21b8004090 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b800bc20 con 0x7f21d00ba550 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cffff640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cf7fe640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 0x7f21b8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21ceffd640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b8004090 0x7f21b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cffff640 1 -- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 msgr2=0x7f21b8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cffff640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21d00ba550 0x7f21b8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cffff640 1 -- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b8004090 msgr2=0x7f21b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cffff640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b8004090 0x7f21b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.206+0000 7f21cffff640 1 -- 172.21.15.6:0/455836693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8003520 con 0x7f21b8004d00 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21cffff640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21c8001fd0 tx=0x7f21b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d5d3745104c8bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8003b70 con 0x7f21b8004d00 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8003cd0 con 0x7f21b8004d00 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21ce7fc640 1 -- 172.21.15.6:0/455836693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80052f0 con 0x7f21b8004d00 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21d6163640 1 -- 172.21.15.6:0/455836693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b8004d00 msgr2=0x7f21b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21d6163640 1 --2- 172.21.15.6:0/455836693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b8004d00 0x7f21b8005180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21c8001fd0 tx=0x7f21b80057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21cffff640 1 -- 172.21.15.6:0/455836693 reap_dead start 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21d6163640 1 -- 172.21.15.6:0/455836693 shutdown_connections 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21d6163640 1 -- 172.21.15.6:0/455836693 >> 172.21.15.6:0/455836693 conn(0x7f21d00c0350 msgr2=0x7f21d00c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.207+0000 7f21d6163640 1 -- 172.21.15.6:0/455836693 shutdown_connections 2023-12-19T13:33:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.208+0000 7f21d6163640 1 -- 172.21.15.6:0/455836693 wait complete. 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.208+0000 7f21d6163640 1 Processor -- start 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 -- start start 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b8004d00 0x7f21d01e0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 0x7f21d01e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d014e3f0 0x7f21d0149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d014e870 con 0x7f21d01d7030 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d01dfa30 con 0x7f21d014e3f0 2023-12-19T13:33:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21d6163640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d01dfd10 con 0x7f21b8004d00 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21ceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 0x7f21d01e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21ceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 0x7f21d01e2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34796/0 (socket says 172.21.15.6:34796) 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.209+0000 7f21ceffd640 1 -- 172.21.15.6:0/2819724901 learned_addr learned my addr 172.21.15.6:0/2819724901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21cffff640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d014e3f0 0x7f21d0149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21cf7fe640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b8004d00 0x7f21d01e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21ceffd640 1 -- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b8004d00 msgr2=0x7f21d01e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21ceffd640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b8004d00 0x7f21d01e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21ceffd640 1 -- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d014e3f0 msgr2=0x7f21d0149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21ceffd640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d014e3f0 0x7f21d0149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21ceffd640 1 -- 172.21.15.6:0/2819724901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d01dfff0 con 0x7f21d01d7030 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21cf7fe640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b8004d00 0x7f21d01e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21ceffd640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 0x7f21d01e2ef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21c4011910 tx=0x7f21c4011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4009590 con 0x7f21d01d7030 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4004240 con 0x7f21d01d7030 2023-12-19T13:33:16.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d0099cc0 con 0x7f21d01d7030 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c400f8e0 con 0x7f21d01d7030 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.210+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00b6660 con 0x7f21d01d7030 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.211+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d01e0180 con 0x7f21d01d7030 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.211+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21c400fa40 con 0x7f21d01d7030 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.212+0000 7f21b7fff640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f21bc06a460 0x7f21bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.212+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c4088f00 con 0x7f21d01d7030 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.212+0000 7f21cf7fe640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f21bc06a460 0x7f21bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.213+0000 7f21cf7fe640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f21bc06a460 0x7f21bc06c920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21c0007d40 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.216+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f21c4058030 con 0x7f21d01d7030 2023-12-19T13:33:16.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.387+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21d01dfba0 con 0x7f21bc06a460 2023-12-19T13:33:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.394+0000 7f21b7fff640 1 -- 172.21.15.6:0/2819724901 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264549 (secure 0 0 0) 0x7f21d01dfba0 con 0x7f21bc06a460 2023-12-19T13:33:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T13:33:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f21bc06a460 msgr2=0x7f21bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f21bc06a460 0x7f21bc06c920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21c0007d40 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2023-12-19T13:33:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 msgr2=0x7f21d01e2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 0x7f21d01e2ef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21c4011910 tx=0x7f21c4011dd0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 shutdown_connections 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f21bc06a460 0x7f21bc06c920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21d014e3f0 0x7f21d0149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d01d7030 0x7f21d01e2ef0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 --2- 172.21.15.6:0/2819724901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b8004d00 0x7f21d01e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 >> 172.21.15.6:0/2819724901 conn(0x7f21d00c0350 msgr2=0x7f21d00a1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 shutdown_connections 2023-12-19T13:33:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.397+0000 7f21d6163640 1 -- 172.21.15.6:0/2819724901 wait complete. 2023-12-19T13:33:16.410 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-19T13:33:15.952928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002195"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466927+0000","last_change":"2023-12-19T13:33:08.041371+0000","last_active":"2023-12-19T13:33:09.466927+0000","last_peered":"2023-12-19T13:33:09.466927+0000","last_clean":"2023-12-19T13:33:09.466927+0000","last_became_active":"2023-12-19T13:33:08.040678+0000","last_became_peered":"2023-12-19T13:33:08.040678+0000","last_unstale":"2023-12-19T13:33:09.466927+0000","last_undegraded":"2023-12-19T13:33:09.466927+0000","last_fullsized":"2023-12-19T13:33:09.466927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037904+0000","last_change":"2023-12-19T13:33:08.043430+0000","last_active":"2023-12-19T13:33:09.037904+0000","last_peered":"2023-12-19T13:33:09.037904+0000","last_clean":"2023-12-19T13:33:09.037904+0000","last_became_active":"2023-12-19T13:33:08.043199+0000","last_became_peered":"2023-12-19T13:33:08.043199+0000","last_unstale":"2023-12-19T13:33:09.037904+0000","last_undegraded":"2023-12-19T13:33:09.037904+0000","last_fullsized":"2023-12-19T13:33:09.037904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467146+0000","last_change":"2023-12-19T13:33:08.049139+0000","last_active":"2023-12-19T13:33:09.467146+0000","last_peered":"2023-12-19T13:33:09.467146+0000","last_clean":"2023-12-19T13:33:09.467146+0000","last_became_active":"2023-12-19T13:33:08.048824+0000","last_became_peered":"2023-12-19T13:33:08.048824+0000","last_unstale":"2023-12-19T13:33:09.467146+0000","last_undegraded":"2023-12-19T13:33:09.467146+0000","last_fullsized":"2023-12-19T13:33:09.467146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:27.092015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466903+0000","last_change":"2023-12-19T13:33:08.058348+0000","last_active":"2023-12-19T13:33:09.466903+0000","last_peered":"2023-12-19T13:33:09.466903+0000","last_clean":"2023-12-19T13:33:09.466903+0000","last_became_active":"2023-12-19T13:33:08.058068+0000","last_became_peered":"2023-12-19T13:33:08.058068+0000","last_unstale":"2023-12-19T13:33:09.466903+0000","last_undegraded":"2023-12-19T13:33:09.466903+0000","last_fullsized":"2023-12-19T13:33:09.466903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:09.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466535+0000","last_change":"2023-12-19T13:33:08.050316+0000","last_active":"2023-12-19T13:33:09.466535+0000","last_peered":"2023-12-19T13:33:09.466535+0000","last_clean":"2023-12-19T13:33:09.466535+0000","last_became_active":"2023-12-19T13:33:08.050049+0000","last_became_peered":"2023-12-19T13:33:08.050049+0000","last_unstale":"2023-12-19T13:33:09.466535+0000","last_undegraded":"2023-12-19T13:33:09.466535+0000","last_fullsized":"2023-12-19T13:33:09.466535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466400+0000","last_change":"2023-12-19T13:33:08.052140+0000","last_active":"2023-12-19T13:33:09.466400+0000","last_peered":"2023-12-19T13:33:09.466400+0000","last_clean":"2023-12-19T13:33:09.466400+0000","last_became_active":"2023-12-19T13:33:08.051880+0000","last_became_peered":"2023-12-19T13:33:08.051880+0000","last_unstale":"2023-12-19T13:33:09.466400+0000","last_undegraded":"2023-12-19T13:33:09.466400+0000","last_fullsized":"2023-12-19T13:33:09.466400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:42:07.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466195+0000","last_change":"2023-12-19T13:33:08.052900+0000","last_active":"2023-12-19T13:33:09.466195+0000","last_peered":"2023-12-19T13:33:09.466195+0000","last_clean":"2023-12-19T13:33:09.466195+0000","last_became_active":"2023-12-19T13:33:08.052646+0000","last_became_peered":"2023-12-19T13:33:08.052646+0000","last_unstale":"2023-12-19T13:33:09.466195+0000","last_undegraded":"2023-12-19T13:33:09.466195+0000","last_fullsized":"2023-12-19T13:33:09.466195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:50:47.691016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466321+0000","last_change":"2023-12-19T13:33:08.055307+0000","last_active":"2023-12-19T13:33:09.466321+0000","last_peered":"2023-12-19T13:33:09.466321+0000","last_clean":"2023-12-19T13:33:09.466321+0000","last_became_active":"2023-12-19T13:33:08.055092+0000","last_became_peered":"2023-12-19T13:33:08.055092+0000","last_unstale":"2023-12-19T13:33:09.466321+0000","last_undegraded":"2023-12-19T13:33:09.466321+0000","last_fullsized":"2023-12-19T13:33:09.466321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467034+0000","last_change":"2023-12-19T13:33:08.052567+0000","last_active":"2023-12-19T13:33:09.467034+0000","last_peered":"2023-12-19T13:33:09.467034+0000","last_clean":"2023-12-19T13:33:09.467034+0000","last_became_active":"2023-12-19T13:33:08.052171+0000","last_became_peered":"2023-12-19T13:33:08.052171+0000","last_unstale":"2023-12-19T13:33:09.467034+0000","last_undegraded":"2023-12-19T13:33:09.467034+0000","last_fullsized":"2023-12-19T13:33:09.467034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:42:07.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039444+0000","last_change":"2023-12-19T13:33:08.056053+0000","last_active":"2023-12-19T13:33:09.039444+0000","last_peered":"2023-12-19T13:33:09.039444+0000","last_clean":"2023-12-19T13:33:09.039444+0000","last_became_active":"2023-12-19T13:33:08.055787+0000","last_became_peered":"2023-12-19T13:33:08.055787+0000","last_unstale":"2023-12-19T13:33:09.039444+0000","last_undegraded":"2023-12-19T13:33:09.039444+0000","last_fullsized":"2023-12-19T13:33:09.039444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039047+0000","last_change":"2023-12-19T13:33:08.056109+0000","last_active":"2023-12-19T13:33:09.039047+0000","last_peered":"2023-12-19T13:33:09.039047+0000","last_clean":"2023-12-19T13:33:09.039047+0000","last_became_active":"2023-12-19T13:33:08.055845+0000","last_became_peered":"2023-12-19T13:33:08.055845+0000","last_unstale":"2023-12-19T13:33:09.039047+0000","last_undegraded":"2023-12-19T13:33:09.039047+0000","last_fullsized":"2023-12-19T13:33:09.039047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039467+0000","last_change":"2023-12-19T13:33:08.042537+0000","last_active":"2023-12-19T13:33:09.039467+0000","last_peered":"2023-12-19T13:33:09.039467+0000","last_clean":"2023-12-19T13:33:09.039467+0000","last_became_active":"2023-12-19T13:33:08.042257+0000","last_became_peered":"2023-12-19T13:33:08.042257+0000","last_unstale":"2023-12-19T13:33:09.039467+0000","last_undegraded":"2023-12-19T13:33:09.039467+0000","last_fullsized":"2023-12-19T13:33:09.039467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:33.372229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466544+0000","last_change":"2023-12-19T13:33:08.043899+0000","last_active":"2023-12-19T13:33:09.466544+0000","last_peered":"2023-12-19T13:33:09.466544+0000","last_clean":"2023-12-19T13:33:09.466544+0000","last_became_active":"2023-12-19T13:33:08.043653+0000","last_became_peered":"2023-12-19T13:33:08.043653+0000","last_unstale":"2023-12-19T13:33:09.466544+0000","last_undegraded":"2023-12-19T13:33:09.466544+0000","last_fullsized":"2023-12-19T13:33:09.466544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466915+0000","last_change":"2023-12-19T13:33:08.044597+0000","last_active":"2023-12-19T13:33:09.466915+0000","last_peered":"2023-12-19T13:33:09.466915+0000","last_clean":"2023-12-19T13:33:09.466915+0000","last_became_active":"2023-12-19T13:33:08.044327+0000","last_became_peered":"2023-12-19T13:33:08.044327+0000","last_unstale":"2023-12-19T13:33:09.466915+0000","last_undegraded":"2023-12-19T13:33:09.466915+0000","last_fullsized":"2023-12-19T13:33:09.466915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037792+0000","last_change":"2023-12-19T13:33:08.045469+0000","last_active":"2023-12-19T13:33:09.037792+0000","last_peered":"2023-12-19T13:33:09.037792+0000","last_clean":"2023-12-19T13:33:09.037792+0000","last_became_active":"2023-12-19T13:33:08.045205+0000","last_became_peered":"2023-12-19T13:33:08.045205+0000","last_unstale":"2023-12-19T13:33:09.037792+0000","last_undegraded":"2023-12-19T13:33:09.037792+0000","last_fullsized":"2023-12-19T13:33:09.037792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466140+0000","last_change":"2023-12-19T13:33:08.053422+0000","last_active":"2023-12-19T13:33:09.466140+0000","last_peered":"2023-12-19T13:33:09.466140+0000","last_clean":"2023-12-19T13:33:09.466140+0000","last_became_active":"2023-12-19T13:33:08.053139+0000","last_became_peered":"2023-12-19T13:33:08.053139+0000","last_unstale":"2023-12-19T13:33:09.466140+0000","last_undegraded":"2023-12-19T13:33:09.466140+0000","last_fullsized":"2023-12-19T13:33:09.466140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:46.064148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467005+0000","last_change":"2023-12-19T13:33:08.057816+0000","last_active":"2023-12-19T13:33:09.467005+0000","last_peered":"2023-12-19T13:33:09.467005+0000","last_clean":"2023-12-19T13:33:09.467005+0000","last_became_active":"2023-12-19T13:33:08.057561+0000","last_became_peered":"2023-12-19T13:33:08.057561+0000","last_unstale":"2023-12-19T13:33:09.467005+0000","last_undegraded":"2023-12-19T13:33:09.467005+0000","last_fullsized":"2023-12-19T13:33:09.467005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466452+0000","last_change":"2023-12-19T13:33:08.041795+0000","last_active":"2023-12-19T13:33:09.466452+0000","last_peered":"2023-12-19T13:33:09.466452+0000","last_clean":"2023-12-19T13:33:09.466452+0000","last_became_active":"2023-12-19T13:33:08.041545+0000","last_became_peered":"2023-12-19T13:33:08.041545+0000","last_unstale":"2023-12-19T13:33:09.466452+0000","last_undegraded":"2023-12-19T13:33:09.466452+0000","last_fullsized":"2023-12-19T13:33:09.466452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:33.372229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467153+0000","last_change":"2023-12-19T13:33:08.049871+0000","last_active":"2023-12-19T13:33:09.467153+0000","last_peered":"2023-12-19T13:33:09.467153+0000","last_clean":"2023-12-19T13:33:09.467153+0000","last_became_active":"2023-12-19T13:33:08.049592+0000","last_became_peered":"2023-12-19T13:33:08.049592+0000","last_unstale":"2023-12-19T13:33:09.467153+0000","last_undegraded":"2023-12-19T13:33:09.467153+0000","last_fullsized":"2023-12-19T13:33:09.467153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039359+0000","last_change":"2023-12-19T13:33:08.046648+0000","last_active":"2023-12-19T13:33:09.039359+0000","last_peered":"2023-12-19T13:33:09.039359+0000","last_clean":"2023-12-19T13:33:09.039359+0000","last_became_active":"2023-12-19T13:33:08.046365+0000","last_became_peered":"2023-12-19T13:33:08.046365+0000","last_unstale":"2023-12-19T13:33:09.039359+0000","last_undegraded":"2023-12-19T13:33:09.039359+0000","last_fullsized":"2023-12-19T13:33:09.039359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467090+0000","last_change":"2023-12-19T13:33:08.050719+0000","last_active":"2023-12-19T13:33:09.467090+0000","last_peered":"2023-12-19T13:33:09.467090+0000","last_clean":"2023-12-19T13:33:09.467090+0000","last_became_active":"2023-12-19T13:33:08.050479+0000","last_became_peered":"2023-12-19T13:33:08.050479+0000","last_unstale":"2023-12-19T13:33:09.467090+0000","last_undegraded":"2023-12-19T13:33:09.467090+0000","last_fullsized":"2023-12-19T13:33:09.467090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466507+0000","last_change":"2023-12-19T13:33:08.056711+0000","last_active":"2023-12-19T13:33:09.466507+0000","last_peered":"2023-12-19T13:33:09.466507+0000","last_clean":"2023-12-19T13:33:09.466507+0000","last_became_active":"2023-12-19T13:33:08.055926+0000","last_became_peered":"2023-12-19T13:33:08.055926+0000","last_unstale":"2023-12-19T13:33:09.466507+0000","last_undegraded":"2023-12-19T13:33:09.466507+0000","last_fullsized":"2023-12-19T13:33:09.466507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:21:45.142469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466502+0000","last_change":"2023-12-19T13:33:08.045737+0000","last_active":"2023-12-19T13:33:09.466502+0000","last_peered":"2023-12-19T13:33:09.466502+0000","last_clean":"2023-12-19T13:33:09.466502+0000","last_became_active":"2023-12-19T13:33:08.045342+0000","last_became_peered":"2023-12-19T13:33:08.045342+0000","last_unstale":"2023-12-19T13:33:09.466502+0000","last_undegraded":"2023-12-19T13:33:09.466502+0000","last_fullsized":"2023-12-19T13:33:09.466502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466274+0000","last_change":"2023-12-19T13:33:08.057789+0000","last_active":"2023-12-19T13:33:09.466274+0000","last_peered":"2023-12-19T13:33:09.466274+0000","last_clean":"2023-12-19T13:33:09.466274+0000","last_became_active":"2023-12-19T13:33:08.057533+0000","last_became_peered":"2023-12-19T13:33:08.057533+0000","last_unstale":"2023-12-19T13:33:09.466274+0000","last_undegraded":"2023-12-19T13:33:09.466274+0000","last_fullsized":"2023-12-19T13:33:09.466274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:08:01.224172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466784+0000","last_change":"2023-12-19T13:33:08.047959+0000","last_active":"2023-12-19T13:33:09.466784+0000","last_peered":"2023-12-19T13:33:09.466784+0000","last_clean":"2023-12-19T13:33:09.466784+0000","last_became_active":"2023-12-19T13:33:08.047597+0000","last_became_peered":"2023-12-19T13:33:08.047597+0000","last_unstale":"2023-12-19T13:33:09.466784+0000","last_undegraded":"2023-12-19T13:33:09.466784+0000","last_fullsized":"2023-12-19T13:33:09.466784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039459+0000","last_change":"2023-12-19T13:33:08.044259+0000","last_active":"2023-12-19T13:33:09.039459+0000","last_peered":"2023-12-19T13:33:09.039459+0000","last_clean":"2023-12-19T13:33:09.039459+0000","last_became_active":"2023-12-19T13:33:08.043702+0000","last_became_peered":"2023-12-19T13:33:08.043702+0000","last_unstale":"2023-12-19T13:33:09.039459+0000","last_undegraded":"2023-12-19T13:33:09.039459+0000","last_fullsized":"2023-12-19T13:33:09.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037888+0000","last_change":"2023-12-19T13:33:08.040797+0000","last_active":"2023-12-19T13:33:09.037888+0000","last_peered":"2023-12-19T13:33:09.037888+0000","last_clean":"2023-12-19T13:33:09.037888+0000","last_became_active":"2023-12-19T13:33:08.040509+0000","last_became_peered":"2023-12-19T13:33:08.040509+0000","last_unstale":"2023-12-19T13:33:09.037888+0000","last_undegraded":"2023-12-19T13:33:09.037888+0000","last_fullsized":"2023-12-19T13:33:09.037888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466911+0000","last_change":"2023-12-19T13:33:08.047963+0000","last_active":"2023-12-19T13:33:09.466911+0000","last_peered":"2023-12-19T13:33:09.466911+0000","last_clean":"2023-12-19T13:33:09.466911+0000","last_became_active":"2023-12-19T13:33:08.047279+0000","last_became_peered":"2023-12-19T13:33:08.047279+0000","last_unstale":"2023-12-19T13:33:09.466911+0000","last_undegraded":"2023-12-19T13:33:09.466911+0000","last_fullsized":"2023-12-19T13:33:09.466911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:27.092015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467135+0000","last_change":"2023-12-19T13:33:08.048816+0000","last_active":"2023-12-19T13:33:09.467135+0000","last_peered":"2023-12-19T13:33:09.467135+0000","last_clean":"2023-12-19T13:33:09.467135+0000","last_became_active":"2023-12-19T13:33:08.044942+0000","last_became_peered":"2023-12-19T13:33:08.044942+0000","last_unstale":"2023-12-19T13:33:09.467135+0000","last_undegraded":"2023-12-19T13:33:09.467135+0000","last_fullsized":"2023-12-19T13:33:09.467135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467033+0000","last_change":"2023-12-19T13:33:08.057063+0000","last_active":"2023-12-19T13:33:09.467033+0000","last_peered":"2023-12-19T13:33:09.467033+0000","last_clean":"2023-12-19T13:33:09.467033+0000","last_became_active":"2023-12-19T13:33:08.056806+0000","last_became_peered":"2023-12-19T13:33:08.056806+0000","last_unstale":"2023-12-19T13:33:09.467033+0000","last_undegraded":"2023-12-19T13:33:09.467033+0000","last_fullsized":"2023-12-19T13:33:09.467033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:05.765112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466207+0000","last_change":"2023-12-19T13:33:08.056055+0000","last_active":"2023-12-19T13:33:09.466207+0000","last_peered":"2023-12-19T13:33:09.466207+0000","last_clean":"2023-12-19T13:33:09.466207+0000","last_became_active":"2023-12-19T13:33:08.055797+0000","last_became_peered":"2023-12-19T13:33:08.055797+0000","last_unstale":"2023-12-19T13:33:09.466207+0000","last_undegraded":"2023-12-19T13:33:09.466207+0000","last_fullsized":"2023-12-19T13:33:09.466207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:52.562074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038687+0000","last_change":"2023-12-19T13:33:08.048418+0000","last_active":"2023-12-19T13:33:09.038687+0000","last_peered":"2023-12-19T13:33:09.038687+0000","last_clean":"2023-12-19T13:33:09.038687+0000","last_became_active":"2023-12-19T13:33:08.048151+0000","last_became_peered":"2023-12-19T13:33:08.048151+0000","last_unstale":"2023-12-19T13:33:09.038687+0000","last_undegraded":"2023-12-19T13:33:09.038687+0000","last_fullsized":"2023-12-19T13:33:09.038687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039686+0000","last_change":"2023-12-19T13:33:08.038978+0000","last_active":"2023-12-19T13:33:09.039686+0000","last_peered":"2023-12-19T13:33:09.039686+0000","last_clean":"2023-12-19T13:33:09.039686+0000","last_became_active":"2023-12-19T13:33:08.038729+0000","last_became_peered":"2023-12-19T13:33:08.038729+0000","last_unstale":"2023-12-19T13:33:09.039686+0000","last_undegraded":"2023-12-19T13:33:09.039686+0000","last_fullsized":"2023-12-19T13:33:09.039686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:14.038723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466660+0000","last_change":"2023-12-19T13:33:07.671519+0000","last_active":"2023-12-19T13:33:09.466660+0000","last_peered":"2023-12-19T13:33:09.466660+0000","last_clean":"2023-12-19T13:33:09.466660+0000","last_became_active":"2023-12-19T13:33:07.671235+0000","last_became_peered":"2023-12-19T13:33:07.671235+0000","last_unstale":"2023-12-19T13:33:09.466660+0000","last_undegraded":"2023-12-19T13:33:09.466660+0000","last_fullsized":"2023-12-19T13:33:09.466660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467228+0000","last_change":"2023-12-19T13:33:08.049297+0000","last_active":"2023-12-19T13:33:09.467228+0000","last_peered":"2023-12-19T13:33:09.467228+0000","last_clean":"2023-12-19T13:33:09.467228+0000","last_became_active":"2023-12-19T13:33:08.049080+0000","last_became_peered":"2023-12-19T13:33:08.049080+0000","last_unstale":"2023-12-19T13:33:09.467228+0000","last_undegraded":"2023-12-19T13:33:09.467228+0000","last_fullsized":"2023-12-19T13:33:09.467228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:00:30.701307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038996+0000","last_change":"2023-12-19T13:33:07.663905+0000","last_active":"2023-12-19T13:33:09.038996+0000","last_peered":"2023-12-19T13:33:09.038996+0000","last_clean":"2023-12-19T13:33:09.038996+0000","last_became_active":"2023-12-19T13:33:07.663563+0000","last_became_peered":"2023-12-19T13:33:07.663563+0000","last_unstale":"2023-12-19T13:33:09.038996+0000","last_undegraded":"2023-12-19T13:33:09.038996+0000","last_fullsized":"2023-12-19T13:33:09.038996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466613+0000","last_change":"2023-12-19T13:33:07.662002+0000","last_active":"2023-12-19T13:33:09.466613+0000","last_peered":"2023-12-19T13:33:09.466613+0000","last_clean":"2023-12-19T13:33:09.466613+0000","last_became_active":"2023-12-19T13:33:07.661666+0000","last_became_peered":"2023-12-19T13:33:07.661666+0000","last_unstale":"2023-12-19T13:33:09.466613+0000","last_undegraded":"2023-12-19T13:33:09.466613+0000","last_fullsized":"2023-12-19T13:33:09.466613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466362+0000","last_change":"2023-12-19T13:33:08.045306+0000","last_active":"2023-12-19T13:33:09.466362+0000","last_peered":"2023-12-19T13:33:09.466362+0000","last_clean":"2023-12-19T13:33:09.466362+0000","last_became_active":"2023-12-19T13:33:08.045039+0000","last_became_peered":"2023-12-19T13:33:08.045039+0000","last_unstale":"2023-12-19T13:33:09.466362+0000","last_undegraded":"2023-12-19T13:33:09.466362+0000","last_fullsized":"2023-12-19T13:33:09.466362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466477+0000","last_change":"2023-12-19T13:33:07.673766+0000","last_active":"2023-12-19T13:33:09.466477+0000","last_peered":"2023-12-19T13:33:09.466477+0000","last_clean":"2023-12-19T13:33:09.466477+0000","last_became_active":"2023-12-19T13:33:07.673463+0000","last_became_peered":"2023-12-19T13:33:07.673463+0000","last_unstale":"2023-12-19T13:33:09.466477+0000","last_undegraded":"2023-12-19T13:33:09.466477+0000","last_fullsized":"2023-12-19T13:33:09.466477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037777+0000","last_change":"2023-12-19T13:33:08.043832+0000","last_active":"2023-12-19T13:33:09.037777+0000","last_peered":"2023-12-19T13:33:09.037777+0000","last_clean":"2023-12-19T13:33:09.037777+0000","last_became_active":"2023-12-19T13:33:08.042167+0000","last_became_peered":"2023-12-19T13:33:08.042167+0000","last_unstale":"2023-12-19T13:33:09.037777+0000","last_undegraded":"2023-12-19T13:33:09.037777+0000","last_fullsized":"2023-12-19T13:33:09.037777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:38:11.798483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039233+0000","last_change":"2023-12-19T13:33:07.671819+0000","last_active":"2023-12-19T13:33:09.039233+0000","last_peered":"2023-12-19T13:33:09.039233+0000","last_clean":"2023-12-19T13:33:09.039233+0000","last_became_active":"2023-12-19T13:33:07.671550+0000","last_became_peered":"2023-12-19T13:33:07.671550+0000","last_unstale":"2023-12-19T13:33:09.039233+0000","last_undegraded":"2023-12-19T13:33:09.039233+0000","last_fullsized":"2023-12-19T13:33:09.039233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466753+0000","last_change":"2023-12-19T13:33:08.056202+0000","last_active":"2023-12-19T13:33:09.466753+0000","last_peered":"2023-12-19T13:33:09.466753+0000","last_clean":"2023-12-19T13:33:09.466753+0000","last_became_active":"2023-12-19T13:33:08.055954+0000","last_became_peered":"2023-12-19T13:33:08.055954+0000","last_unstale":"2023-12-19T13:33:09.466753+0000","last_undegraded":"2023-12-19T13:33:09.466753+0000","last_fullsized":"2023-12-19T13:33:09.466753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466862+0000","last_change":"2023-12-19T13:33:07.672051+0000","last_active":"2023-12-19T13:33:09.466862+0000","last_peered":"2023-12-19T13:33:09.466862+0000","last_clean":"2023-12-19T13:33:09.466862+0000","last_became_active":"2023-12-19T13:33:07.671460+0000","last_became_peered":"2023-12-19T13:33:07.671460+0000","last_unstale":"2023-12-19T13:33:09.466862+0000","last_undegraded":"2023-12-19T13:33:09.466862+0000","last_fullsized":"2023-12-19T13:33:09.466862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467333+0000","last_change":"2023-12-19T13:33:08.049996+0000","last_active":"2023-12-19T13:33:09.467333+0000","last_peered":"2023-12-19T13:33:09.467333+0000","last_clean":"2023-12-19T13:33:09.467333+0000","last_became_active":"2023-12-19T13:33:08.049731+0000","last_became_peered":"2023-12-19T13:33:08.049731+0000","last_unstale":"2023-12-19T13:33:09.467333+0000","last_undegraded":"2023-12-19T13:33:09.467333+0000","last_fullsized":"2023-12-19T13:33:09.467333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037979+0000","last_change":"2023-12-19T13:33:07.669934+0000","last_active":"2023-12-19T13:33:09.037979+0000","last_peered":"2023-12-19T13:33:09.037979+0000","last_clean":"2023-12-19T13:33:09.037979+0000","last_became_active":"2023-12-19T13:33:07.669396+0000","last_became_peered":"2023-12-19T13:33:07.669396+0000","last_unstale":"2023-12-19T13:33:09.037979+0000","last_undegraded":"2023-12-19T13:33:09.037979+0000","last_fullsized":"2023-12-19T13:33:09.037979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039568+0000","last_change":"2023-12-19T13:33:08.053672+0000","last_active":"2023-12-19T13:33:09.039568+0000","last_peered":"2023-12-19T13:33:09.039568+0000","last_clean":"2023-12-19T13:33:09.039568+0000","last_became_active":"2023-12-19T13:33:08.052055+0000","last_became_peered":"2023-12-19T13:33:08.052055+0000","last_unstale":"2023-12-19T13:33:09.039568+0000","last_undegraded":"2023-12-19T13:33:09.039568+0000","last_fullsized":"2023-12-19T13:33:09.039568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:17:53.430044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039446+0000","last_change":"2023-12-19T13:33:07.666435+0000","last_active":"2023-12-19T13:33:09.039446+0000","last_peered":"2023-12-19T13:33:09.039446+0000","last_clean":"2023-12-19T13:33:09.039446+0000","last_became_active":"2023-12-19T13:33:07.666031+0000","last_became_peered":"2023-12-19T13:33:07.666031+0000","last_unstale":"2023-12-19T13:33:09.039446+0000","last_undegraded":"2023-12-19T13:33:09.039446+0000","last_fullsized":"2023-12-19T13:33:09.039446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466989+0000","last_change":"2023-12-19T13:33:08.046354+0000","last_active":"2023-12-19T13:33:09.466989+0000","last_peered":"2023-12-19T13:33:09.466989+0000","last_clean":"2023-12-19T13:33:09.466989+0000","last_became_active":"2023-12-19T13:33:08.046083+0000","last_became_peered":"2023-12-19T13:33:08.046083+0000","last_unstale":"2023-12-19T13:33:09.466989+0000","last_undegraded":"2023-12-19T13:33:09.466989+0000","last_fullsized":"2023-12-19T13:33:09.466989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467261+0000","last_change":"2023-12-19T13:33:07.666609+0000","last_active":"2023-12-19T13:33:09.467261+0000","last_peered":"2023-12-19T13:33:09.467261+0000","last_clean":"2023-12-19T13:33:09.467261+0000","last_became_active":"2023-12-19T13:33:07.665764+0000","last_became_peered":"2023-12-19T13:33:07.665764+0000","last_unstale":"2023-12-19T13:33:09.467261+0000","last_undegraded":"2023-12-19T13:33:09.467261+0000","last_fullsized":"2023-12-19T13:33:09.467261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466915+0000","last_change":"2023-12-19T13:33:08.051291+0000","last_active":"2023-12-19T13:33:09.466915+0000","last_peered":"2023-12-19T13:33:09.466915+0000","last_clean":"2023-12-19T13:33:09.466915+0000","last_became_active":"2023-12-19T13:33:08.051016+0000","last_became_peered":"2023-12-19T13:33:08.051016+0000","last_unstale":"2023-12-19T13:33:09.466915+0000","last_undegraded":"2023-12-19T13:33:09.466915+0000","last_fullsized":"2023-12-19T13:33:09.466915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:40.694305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466597+0000","last_change":"2023-12-19T13:33:07.675720+0000","last_active":"2023-12-19T13:33:09.466597+0000","last_peered":"2023-12-19T13:33:09.466597+0000","last_clean":"2023-12-19T13:33:09.466597+0000","last_became_active":"2023-12-19T13:33:07.675434+0000","last_became_peered":"2023-12-19T13:33:07.675434+0000","last_unstale":"2023-12-19T13:33:09.466597+0000","last_undegraded":"2023-12-19T13:33:09.466597+0000","last_fullsized":"2023-12-19T13:33:09.466597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466680+0000","last_change":"2023-12-19T13:33:08.051519+0000","last_active":"2023-12-19T13:33:09.466680+0000","last_peered":"2023-12-19T13:33:09.466680+0000","last_clean":"2023-12-19T13:33:09.466680+0000","last_became_active":"2023-12-19T13:33:08.050189+0000","last_became_peered":"2023-12-19T13:33:08.050189+0000","last_unstale":"2023-12-19T13:33:09.466680+0000","last_undegraded":"2023-12-19T13:33:09.466680+0000","last_fullsized":"2023-12-19T13:33:09.466680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038751+0000","last_change":"2023-12-19T13:33:07.663565+0000","last_active":"2023-12-19T13:33:09.038751+0000","last_peered":"2023-12-19T13:33:09.038751+0000","last_clean":"2023-12-19T13:33:09.038751+0000","last_became_active":"2023-12-19T13:33:07.663174+0000","last_became_peered":"2023-12-19T13:33:07.663174+0000","last_unstale":"2023-12-19T13:33:09.038751+0000","last_undegraded":"2023-12-19T13:33:09.038751+0000","last_fullsized":"2023-12-19T13:33:09.038751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038815+0000","last_change":"2023-12-19T13:33:08.048060+0000","last_active":"2023-12-19T13:33:09.038815+0000","last_peered":"2023-12-19T13:33:09.038815+0000","last_clean":"2023-12-19T13:33:09.038815+0000","last_became_active":"2023-12-19T13:33:08.047791+0000","last_became_peered":"2023-12-19T13:33:08.047791+0000","last_unstale":"2023-12-19T13:33:09.038815+0000","last_undegraded":"2023-12-19T13:33:09.038815+0000","last_fullsized":"2023-12-19T13:33:09.038815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.465958+0000","last_change":"2023-12-19T13:33:07.665027+0000","last_active":"2023-12-19T13:33:09.465958+0000","last_peered":"2023-12-19T13:33:09.465958+0000","last_clean":"2023-12-19T13:33:09.465958+0000","last_became_active":"2023-12-19T13:33:07.664706+0000","last_became_peered":"2023-12-19T13:33:07.664706+0000","last_unstale":"2023-12-19T13:33:09.465958+0000","last_undegraded":"2023-12-19T13:33:09.465958+0000","last_fullsized":"2023-12-19T13:33:09.465958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466823+0000","last_change":"2023-12-19T13:33:08.052125+0000","last_active":"2023-12-19T13:33:09.466823+0000","last_peered":"2023-12-19T13:33:09.466823+0000","last_clean":"2023-12-19T13:33:09.466823+0000","last_became_active":"2023-12-19T13:33:08.051831+0000","last_became_peered":"2023-12-19T13:33:08.051831+0000","last_unstale":"2023-12-19T13:33:09.466823+0000","last_undegraded":"2023-12-19T13:33:09.466823+0000","last_fullsized":"2023-12-19T13:33:09.466823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:24:05.765112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039227+0000","last_change":"2023-12-19T13:33:07.668053+0000","last_active":"2023-12-19T13:33:09.039227+0000","last_peered":"2023-12-19T13:33:09.039227+0000","last_clean":"2023-12-19T13:33:09.039227+0000","last_became_active":"2023-12-19T13:33:07.667791+0000","last_became_peered":"2023-12-19T13:33:07.667791+0000","last_unstale":"2023-12-19T13:33:09.039227+0000","last_undegraded":"2023-12-19T13:33:09.039227+0000","last_fullsized":"2023-12-19T13:33:09.039227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:21:47.342437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466698+0000","last_change":"2023-12-19T13:33:08.049950+0000","last_active":"2023-12-19T13:33:09.466698+0000","last_peered":"2023-12-19T13:33:09.466698+0000","last_clean":"2023-12-19T13:33:09.466698+0000","last_became_active":"2023-12-19T13:33:08.049688+0000","last_became_peered":"2023-12-19T13:33:08.049688+0000","last_unstale":"2023-12-19T13:33:09.466698+0000","last_undegraded":"2023-12-19T13:33:09.466698+0000","last_fullsized":"2023-12-19T13:33:09.466698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:05.364189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466401+0000","last_change":"2023-12-19T13:33:07.671312+0000","last_active":"2023-12-19T13:33:09.466401+0000","last_peered":"2023-12-19T13:33:09.466401+0000","last_clean":"2023-12-19T13:33:09.466401+0000","last_became_active":"2023-12-19T13:33:07.670997+0000","last_became_peered":"2023-12-19T13:33:07.670997+0000","last_unstale":"2023-12-19T13:33:09.466401+0000","last_undegraded":"2023-12-19T13:33:09.466401+0000","last_fullsized":"2023-12-19T13:33:09.466401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467114+0000","last_change":"2023-12-19T13:33:08.052491+0000","last_active":"2023-12-19T13:33:09.467114+0000","last_peered":"2023-12-19T13:33:09.467114+0000","last_clean":"2023-12-19T13:33:09.467114+0000","last_became_active":"2023-12-19T13:33:08.050405+0000","last_became_peered":"2023-12-19T13:33:08.050405+0000","last_unstale":"2023-12-19T13:33:09.467114+0000","last_undegraded":"2023-12-19T13:33:09.467114+0000","last_fullsized":"2023-12-19T13:33:09.467114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:09.132007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038055+0000","last_change":"2023-12-19T13:33:07.673634+0000","last_active":"2023-12-19T13:33:09.038055+0000","last_peered":"2023-12-19T13:33:09.038055+0000","last_clean":"2023-12-19T13:33:09.038055+0000","last_became_active":"2023-12-19T13:33:07.673391+0000","last_became_peered":"2023-12-19T13:33:07.673391+0000","last_unstale":"2023-12-19T13:33:09.038055+0000","last_undegraded":"2023-12-19T13:33:09.038055+0000","last_fullsized":"2023-12-19T13:33:09.038055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466616+0000","last_change":"2023-12-19T13:33:08.057771+0000","last_active":"2023-12-19T13:33:09.466616+0000","last_peered":"2023-12-19T13:33:09.466616+0000","last_clean":"2023-12-19T13:33:09.466616+0000","last_became_active":"2023-12-19T13:33:08.057153+0000","last_became_peered":"2023-12-19T13:33:08.057153+0000","last_unstale":"2023-12-19T13:33:09.466616+0000","last_undegraded":"2023-12-19T13:33:09.466616+0000","last_fullsized":"2023-12-19T13:33:09.466616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:41:05.364189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466126+0000","last_change":"2023-12-19T13:33:07.670225+0000","last_active":"2023-12-19T13:33:09.466126+0000","last_peered":"2023-12-19T13:33:09.466126+0000","last_clean":"2023-12-19T13:33:09.466126+0000","last_became_active":"2023-12-19T13:33:07.669851+0000","last_became_peered":"2023-12-19T13:33:07.669851+0000","last_unstale":"2023-12-19T13:33:09.466126+0000","last_undegraded":"2023-12-19T13:33:09.466126+0000","last_fullsized":"2023-12-19T13:33:09.466126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467033+0000","last_change":"2023-12-19T13:33:08.056812+0000","last_active":"2023-12-19T13:33:09.467033+0000","last_peered":"2023-12-19T13:33:09.467033+0000","last_clean":"2023-12-19T13:33:09.467033+0000","last_became_active":"2023-12-19T13:33:08.056390+0000","last_became_peered":"2023-12-19T13:33:08.056390+0000","last_unstale":"2023-12-19T13:33:09.467033+0000","last_undegraded":"2023-12-19T13:33:09.467033+0000","last_fullsized":"2023-12-19T13:33:09.467033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:46.064148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T13:33:08.037035+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T13:33:08.037035+0000","last_peered":"2023-12-19T13:33:08.037035+0000","last_clean":"2023-12-19T13:33:08.037035+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T13:33:08.037035+0000","last_undegraded":"2023-12-19T13:33:08.037035+0000","last_fullsized":"2023-12-19T13:33:08.037035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466303+0000","last_change":"2023-12-19T13:33:07.669727+0000","last_active":"2023-12-19T13:33:09.466303+0000","last_peered":"2023-12-19T13:33:09.466303+0000","last_clean":"2023-12-19T13:33:09.466303+0000","last_became_active":"2023-12-19T13:33:07.669402+0000","last_became_peered":"2023-12-19T13:33:07.669402+0000","last_unstale":"2023-12-19T13:33:09.466303+0000","last_undegraded":"2023-12-19T13:33:09.466303+0000","last_fullsized":"2023-12-19T13:33:09.466303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466755+0000","last_change":"2023-12-19T13:33:08.053509+0000","last_active":"2023-12-19T13:33:09.466755+0000","last_peered":"2023-12-19T13:33:09.466755+0000","last_clean":"2023-12-19T13:33:09.466755+0000","last_became_active":"2023-12-19T13:33:08.053242+0000","last_became_peered":"2023-12-19T13:33:08.053242+0000","last_unstale":"2023-12-19T13:33:09.466755+0000","last_undegraded":"2023-12-19T13:33:09.466755+0000","last_fullsized":"2023-12-19T13:33:09.466755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:24:41.509835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466114+0000","last_change":"2023-12-19T13:33:07.672010+0000","last_active":"2023-12-19T13:33:09.466114+0000","last_peered":"2023-12-19T13:33:09.466114+0000","last_clean":"2023-12-19T13:33:09.466114+0000","last_became_active":"2023-12-19T13:33:07.671753+0000","last_became_peered":"2023-12-19T13:33:07.671753+0000","last_unstale":"2023-12-19T13:33:09.466114+0000","last_undegraded":"2023-12-19T13:33:09.466114+0000","last_fullsized":"2023-12-19T13:33:09.466114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:32.366813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466752+0000","last_change":"2023-12-19T13:33:08.046756+0000","last_active":"2023-12-19T13:33:09.466752+0000","last_peered":"2023-12-19T13:33:09.466752+0000","last_clean":"2023-12-19T13:33:09.466752+0000","last_became_active":"2023-12-19T13:33:08.046513+0000","last_became_peered":"2023-12-19T13:33:08.046513+0000","last_unstale":"2023-12-19T13:33:09.466752+0000","last_undegraded":"2023-12-19T13:33:09.466752+0000","last_fullsized":"2023-12-19T13:33:09.466752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466102+0000","last_change":"2023-12-19T13:33:07.666893+0000","last_active":"2023-12-19T13:33:09.466102+0000","last_peered":"2023-12-19T13:33:09.466102+0000","last_clean":"2023-12-19T13:33:09.466102+0000","last_became_active":"2023-12-19T13:33:07.666570+0000","last_became_peered":"2023-12-19T13:33:07.666570+0000","last_unstale":"2023-12-19T13:33:09.466102+0000","last_undegraded":"2023-12-19T13:33:09.466102+0000","last_fullsized":"2023-12-19T13:33:09.466102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037791+0000","last_change":"2023-12-19T13:33:08.044537+0000","last_active":"2023-12-19T13:33:09.037791+0000","last_peered":"2023-12-19T13:33:09.037791+0000","last_clean":"2023-12-19T13:33:09.037791+0000","last_became_active":"2023-12-19T13:33:08.043564+0000","last_became_peered":"2023-12-19T13:33:08.043564+0000","last_unstale":"2023-12-19T13:33:09.037791+0000","last_undegraded":"2023-12-19T13:33:09.037791+0000","last_fullsized":"2023-12-19T13:33:09.037791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466693+0000","last_change":"2023-12-19T13:33:07.671346+0000","last_active":"2023-12-19T13:33:09.466693+0000","last_peered":"2023-12-19T13:33:09.466693+0000","last_clean":"2023-12-19T13:33:09.466693+0000","last_became_active":"2023-12-19T13:33:07.670835+0000","last_became_peered":"2023-12-19T13:33:07.670835+0000","last_unstale":"2023-12-19T13:33:09.466693+0000","last_undegraded":"2023-12-19T13:33:09.466693+0000","last_fullsized":"2023-12-19T13:33:09.466693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039595+0000","last_change":"2023-12-19T13:33:08.052676+0000","last_active":"2023-12-19T13:33:09.039595+0000","last_peered":"2023-12-19T13:33:09.039595+0000","last_clean":"2023-12-19T13:33:09.039595+0000","last_became_active":"2023-12-19T13:33:08.052415+0000","last_became_peered":"2023-12-19T13:33:08.052415+0000","last_unstale":"2023-12-19T13:33:09.039595+0000","last_undegraded":"2023-12-19T13:33:09.039595+0000","last_fullsized":"2023-12-19T13:33:09.039595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:52.562074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037987+0000","last_change":"2023-12-19T13:33:07.668666+0000","last_active":"2023-12-19T13:33:09.037987+0000","last_peered":"2023-12-19T13:33:09.037987+0000","last_clean":"2023-12-19T13:33:09.037987+0000","last_became_active":"2023-12-19T13:33:07.668398+0000","last_became_peered":"2023-12-19T13:33:07.668398+0000","last_unstale":"2023-12-19T13:33:09.037987+0000","last_undegraded":"2023-12-19T13:33:09.037987+0000","last_fullsized":"2023-12-19T13:33:09.037987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467057+0000","last_change":"2023-12-19T13:33:08.058068+0000","last_active":"2023-12-19T13:33:09.467057+0000","last_peered":"2023-12-19T13:33:09.467057+0000","last_clean":"2023-12-19T13:33:09.467057+0000","last_became_active":"2023-12-19T13:33:08.057740+0000","last_became_peered":"2023-12-19T13:33:08.057740+0000","last_unstale":"2023-12-19T13:33:09.467057+0000","last_undegraded":"2023-12-19T13:33:09.467057+0000","last_fullsized":"2023-12-19T13:33:09.467057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467178+0000","last_change":"2023-12-19T13:33:07.675084+0000","last_active":"2023-12-19T13:33:09.467178+0000","last_peered":"2023-12-19T13:33:09.467178+0000","last_clean":"2023-12-19T13:33:09.467178+0000","last_became_active":"2023-12-19T13:33:07.674840+0000","last_became_peered":"2023-12-19T13:33:07.674840+0000","last_unstale":"2023-12-19T13:33:09.467178+0000","last_undegraded":"2023-12-19T13:33:09.467178+0000","last_fullsized":"2023-12-19T13:33:09.467178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:48.601576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037889+0000","last_change":"2023-12-19T13:33:08.043314+0000","last_active":"2023-12-19T13:33:09.037889+0000","last_peered":"2023-12-19T13:33:09.037889+0000","last_clean":"2023-12-19T13:33:09.037889+0000","last_became_active":"2023-12-19T13:33:08.043051+0000","last_became_peered":"2023-12-19T13:33:08.043051+0000","last_unstale":"2023-12-19T13:33:09.037889+0000","last_undegraded":"2023-12-19T13:33:09.037889+0000","last_fullsized":"2023-12-19T13:33:09.037889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:10.970740+0000","last_change":"2023-12-19T13:33:07.665299+0000","last_active":"2023-12-19T13:33:10.970740+0000","last_peered":"2023-12-19T13:33:10.970740+0000","last_clean":"2023-12-19T13:33:10.970740+0000","last_became_active":"2023-12-19T13:33:07.665030+0000","last_became_peered":"2023-12-19T13:33:07.665030+0000","last_unstale":"2023-12-19T13:33:10.970740+0000","last_undegraded":"2023-12-19T13:33:10.970740+0000","last_fullsized":"2023-12-19T13:33:10.970740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466907+0000","last_change":"2023-12-19T13:33:08.050353+0000","last_active":"2023-12-19T13:33:09.466907+0000","last_peered":"2023-12-19T13:33:09.466907+0000","last_clean":"2023-12-19T13:33:09.466907+0000","last_became_active":"2023-12-19T13:33:08.050051+0000","last_became_peered":"2023-12-19T13:33:08.050051+0000","last_unstale":"2023-12-19T13:33:09.466907+0000","last_undegraded":"2023-12-19T13:33:09.466907+0000","last_fullsized":"2023-12-19T13:33:09.466907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:47:10.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039345+0000","last_change":"2023-12-19T13:33:07.668359+0000","last_active":"2023-12-19T13:33:09.039345+0000","last_peered":"2023-12-19T13:33:09.039345+0000","last_clean":"2023-12-19T13:33:09.039345+0000","last_became_active":"2023-12-19T13:33:07.668113+0000","last_became_peered":"2023-12-19T13:33:07.668113+0000","last_unstale":"2023-12-19T13:33:09.039345+0000","last_undegraded":"2023-12-19T13:33:09.039345+0000","last_fullsized":"2023-12-19T13:33:09.039345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.568401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467364+0000","last_change":"2023-12-19T13:33:08.047035+0000","last_active":"2023-12-19T13:33:09.467364+0000","last_peered":"2023-12-19T13:33:09.467364+0000","last_clean":"2023-12-19T13:33:09.467364+0000","last_became_active":"2023-12-19T13:33:08.045656+0000","last_became_peered":"2023-12-19T13:33:08.045656+0000","last_unstale":"2023-12-19T13:33:09.467364+0000","last_undegraded":"2023-12-19T13:33:09.467364+0000","last_fullsized":"2023-12-19T13:33:09.467364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:51:34.290103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466112+0000","last_change":"2023-12-19T13:33:07.676027+0000","last_active":"2023-12-19T13:33:09.466112+0000","last_peered":"2023-12-19T13:33:09.466112+0000","last_clean":"2023-12-19T13:33:09.466112+0000","last_became_active":"2023-12-19T13:33:07.675643+0000","last_became_peered":"2023-12-19T13:33:07.675643+0000","last_unstale":"2023-12-19T13:33:09.466112+0000","last_undegraded":"2023-12-19T13:33:09.466112+0000","last_fullsized":"2023-12-19T13:33:09.466112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:12.069063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.039707+0000","last_change":"2023-12-19T13:33:08.044642+0000","last_active":"2023-12-19T13:33:09.039707+0000","last_peered":"2023-12-19T13:33:09.039707+0000","last_clean":"2023-12-19T13:33:09.039707+0000","last_became_active":"2023-12-19T13:33:08.044393+0000","last_became_peered":"2023-12-19T13:33:08.044393+0000","last_unstale":"2023-12-19T13:33:09.039707+0000","last_undegraded":"2023-12-19T13:33:09.039707+0000","last_fullsized":"2023-12-19T13:33:09.039707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:56:13.074479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037873+0000","last_change":"2023-12-19T13:33:07.672222+0000","last_active":"2023-12-19T13:33:09.037873+0000","last_peered":"2023-12-19T13:33:09.037873+0000","last_clean":"2023-12-19T13:33:09.037873+0000","last_became_active":"2023-12-19T13:33:07.671916+0000","last_became_peered":"2023-12-19T13:33:07.671916+0000","last_unstale":"2023-12-19T13:33:09.037873+0000","last_undegraded":"2023-12-19T13:33:09.037873+0000","last_fullsized":"2023-12-19T13:33:09.037873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:43.866019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466479+0000","last_change":"2023-12-19T13:33:08.046213+0000","last_active":"2023-12-19T13:33:09.466479+0000","last_peered":"2023-12-19T13:33:09.466479+0000","last_clean":"2023-12-19T13:33:09.466479+0000","last_became_active":"2023-12-19T13:33:08.045740+0000","last_became_peered":"2023-12-19T13:33:08.045740+0000","last_unstale":"2023-12-19T13:33:09.466479+0000","last_undegraded":"2023-12-19T13:33:09.466479+0000","last_fullsized":"2023-12-19T13:33:09.466479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:33.330344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.037969+0000","last_change":"2023-12-19T13:33:07.674107+0000","last_active":"2023-12-19T13:33:09.037969+0000","last_peered":"2023-12-19T13:33:09.037969+0000","last_clean":"2023-12-19T13:33:09.037969+0000","last_became_active":"2023-12-19T13:33:07.673826+0000","last_became_peered":"2023-12-19T13:33:07.673826+0000","last_unstale":"2023-12-19T13:33:09.037969+0000","last_undegraded":"2023-12-19T13:33:09.037969+0000","last_fullsized":"2023-12-19T13:33:09.037969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:31:10.246255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466593+0000","last_change":"2023-12-19T13:33:08.053691+0000","last_active":"2023-12-19T13:33:09.466593+0000","last_peered":"2023-12-19T13:33:09.466593+0000","last_clean":"2023-12-19T13:33:09.466593+0000","last_became_active":"2023-12-19T13:33:08.052956+0000","last_became_peered":"2023-12-19T13:33:08.052956+0000","last_unstale":"2023-12-19T13:33:09.466593+0000","last_undegraded":"2023-12-19T13:33:09.466593+0000","last_fullsized":"2023-12-19T13:33:09.466593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:36:16.597720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466990+0000","last_change":"2023-12-19T13:33:07.673744+0000","last_active":"2023-12-19T13:33:09.466990+0000","last_peered":"2023-12-19T13:33:09.466990+0000","last_clean":"2023-12-19T13:33:09.466990+0000","last_became_active":"2023-12-19T13:33:07.673350+0000","last_became_peered":"2023-12-19T13:33:07.673350+0000","last_unstale":"2023-12-19T13:33:09.466990+0000","last_undegraded":"2023-12-19T13:33:09.466990+0000","last_fullsized":"2023-12-19T13:33:09.466990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:04:51.556658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.038917+0000","last_change":"2023-12-19T13:33:08.047155+0000","last_active":"2023-12-19T13:33:09.038917+0000","last_peered":"2023-12-19T13:33:09.038917+0000","last_clean":"2023-12-19T13:33:09.038917+0000","last_became_active":"2023-12-19T13:33:08.046913+0000","last_became_peered":"2023-12-19T13:33:08.046913+0000","last_unstale":"2023-12-19T13:33:09.038917+0000","last_undegraded":"2023-12-19T13:33:09.038917+0000","last_fullsized":"2023-12-19T13:33:09.038917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:00:30.701307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466703+0000","last_change":"2023-12-19T13:33:08.059339+0000","last_active":"2023-12-19T13:33:09.466703+0000","last_peered":"2023-12-19T13:33:09.466703+0000","last_clean":"2023-12-19T13:33:09.466703+0000","last_became_active":"2023-12-19T13:33:08.059075+0000","last_became_peered":"2023-12-19T13:33:08.059075+0000","last_unstale":"2023-12-19T13:33:09.466703+0000","last_undegraded":"2023-12-19T13:33:09.466703+0000","last_fullsized":"2023-12-19T13:33:09.466703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:39.315238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466938+0000","last_change":"2023-12-19T13:33:07.672573+0000","last_active":"2023-12-19T13:33:09.466938+0000","last_peered":"2023-12-19T13:33:09.466938+0000","last_clean":"2023-12-19T13:33:09.466938+0000","last_became_active":"2023-12-19T13:33:07.672300+0000","last_became_peered":"2023-12-19T13:33:07.672300+0000","last_unstale":"2023-12-19T13:33:09.466938+0000","last_undegraded":"2023-12-19T13:33:09.466938+0000","last_fullsized":"2023-12-19T13:33:09.466938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:17:52.424628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466505+0000","last_change":"2023-12-19T13:33:08.059145+0000","last_active":"2023-12-19T13:33:09.466505+0000","last_peered":"2023-12-19T13:33:09.466505+0000","last_clean":"2023-12-19T13:33:09.466505+0000","last_became_active":"2023-12-19T13:33:08.058854+0000","last_became_peered":"2023-12-19T13:33:08.058854+0000","last_unstale":"2023-12-19T13:33:09.466505+0000","last_undegraded":"2023-12-19T13:33:09.466505+0000","last_fullsized":"2023-12-19T13:33:09.466505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:05.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467092+0000","last_change":"2023-12-19T13:33:07.670541+0000","last_active":"2023-12-19T13:33:09.467092+0000","last_peered":"2023-12-19T13:33:09.467092+0000","last_clean":"2023-12-19T13:33:09.467092+0000","last_became_active":"2023-12-19T13:33:07.670255+0000","last_became_peered":"2023-12-19T13:33:07.670255+0000","last_unstale":"2023-12-19T13:33:09.467092+0000","last_undegraded":"2023-12-19T13:33:09.467092+0000","last_fullsized":"2023-12-19T13:33:09.467092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:24.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467194+0000","last_change":"2023-12-19T13:33:08.056004+0000","last_active":"2023-12-19T13:33:09.467194+0000","last_peered":"2023-12-19T13:33:09.467194+0000","last_clean":"2023-12-19T13:33:09.467194+0000","last_became_active":"2023-12-19T13:33:08.055703+0000","last_became_peered":"2023-12-19T13:33:08.055703+0000","last_unstale":"2023-12-19T13:33:09.467194+0000","last_undegraded":"2023-12-19T13:33:09.467194+0000","last_fullsized":"2023-12-19T13:33:09.467194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:13.533353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467024+0000","last_change":"2023-12-19T13:33:07.675986+0000","last_active":"2023-12-19T13:33:09.467024+0000","last_peered":"2023-12-19T13:33:09.467024+0000","last_clean":"2023-12-19T13:33:09.467024+0000","last_became_active":"2023-12-19T13:33:07.675686+0000","last_became_peered":"2023-12-19T13:33:07.675686+0000","last_unstale":"2023-12-19T13:33:09.467024+0000","last_undegraded":"2023-12-19T13:33:09.467024+0000","last_fullsized":"2023-12-19T13:33:09.467024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.466896+0000","last_change":"2023-12-19T13:33:08.045717+0000","last_active":"2023-12-19T13:33:09.466896+0000","last_peered":"2023-12-19T13:33:09.466896+0000","last_clean":"2023-12-19T13:33:09.466896+0000","last_became_active":"2023-12-19T13:33:08.045449+0000","last_became_peered":"2023-12-19T13:33:08.045449+0000","last_unstale":"2023-12-19T13:33:09.466896+0000","last_undegraded":"2023-12-19T13:33:09.466896+0000","last_fullsized":"2023-12-19T13:33:09.466896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:07.647893+0000","last_clean_scrub_stamp":"2023-12-19T13:33:07.647893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:25.360489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T13:33:09.467371+0000","last_change":"2023-12-19T13:33:07.673708+0000","last_active":"2023-12-19T13:33:09.467371+0000","last_peered":"2023-12-19T13:33:09.467371+0000","last_clean":"2023-12-19T13:33:09.467371+0000","last_became_active":"2023-12-19T13:33:07.673458+0000","last_became_peered":"2023-12-19T13:33:07.673458+0000","last_unstale":"2023-12-19T13:33:09.467371+0000","last_undegraded":"2023-12-19T13:33:09.467371+0000","last_fullsized":"2023-12-19T13:33:09.467371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:06.642477+0000","last_clean_scrub_stamp":"2023-12-19T13:33:06.642477+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:05.020634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":69879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T13:33:16.414 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T13:33:16.414 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T13:33:16.414 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T13:33:16.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T13:33:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d62d4640 1 Processor -- start 2023-12-19T13:33:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d62d4640 1 -- start start 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d62d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86d014b1f0 0x7f86d0156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d62d4640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d006b820 con 0x7f86d006d770 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d62d4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d006eac0 con 0x7f86d00ba290 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d62d4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d006de60 con 0x7f86d014b1f0 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86cf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f86d006d770 0x7f86d014aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57190/0 (socket says 172.21.15.6:57190) 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.554+0000 7f86cf7fe640 1 -- 172.21.15.6:0/395261031 learned_addr learned my addr 172.21.15.6:0/395261031 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.553+0000 7f86d4871640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86d014b1f0 0x7f86d0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.554+0000 7f86d4871640 1 -- 172.21.15.6:0/395261031 >> v1:172.21.15.89:6789/0 conn(0x7f86d00ba290 legacy=0x7f86d006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.554+0000 7f86d4871640 1 -- 172.21.15.6:0/395261031 >> v1:172.21.15.6:6789/0 conn(0x7f86d006d770 legacy=0x7f86d014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.554+0000 7f86d4871640 1 -- 172.21.15.6:0/395261031 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d006aef0 con 0x7f86d014b1f0 2023-12-19T13:33:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.554+0000 7f86ceffd640 1 -- 172.21.15.6:0/395261031 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122631260 0 0) 0x7f86d006b820 con 0x7f86d006d770 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d4871640 1 --2- 172.21.15.6:0/395261031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d014b1f0 0x7f86d0156430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009d90 tx=0x7f86c802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e6f82253bf1d87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86ceffd640 1 -- 172.21.15.6:0/395261031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c802cd00 con 0x7f86d014b1f0 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86ceffd640 1 -- 172.21.15.6:0/395261031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c802ce60 con 0x7f86d014b1f0 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86ceffd640 1 -- 172.21.15.6:0/395261031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8034660 con 0x7f86d014b1f0 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 -- 172.21.15.6:0/395261031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d014b1f0 msgr2=0x7f86d0156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 --2- 172.21.15.6:0/395261031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d014b1f0 0x7f86d0156430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009d90 tx=0x7f86c802bf50 comp rx=0 tx=0).stop 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 -- 172.21.15.6:0/395261031 shutdown_connections 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 --2- 172.21.15.6:0/395261031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d014b1f0 0x7f86d0156430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 -- 172.21.15.6:0/395261031 >> 172.21.15.6:0/395261031 conn(0x7f86d00bac30 msgr2=0x7f86d00bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 -- 172.21.15.6:0/395261031 shutdown_connections 2023-12-19T13:33:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.555+0000 7f86d62d4640 1 -- 172.21.15.6:0/395261031 wait complete. 2023-12-19T13:33:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.556+0000 7f86d62d4640 1 Processor -- start 2023-12-19T13:33:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 -- start start 2023-12-19T13:33:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 0x7f86d014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d00ba290 0x7f86d01e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d014b1f0 0x7f86d01e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d014e020 con 0x7f86d006d770 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d014cc50 con 0x7f86d00ba290 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d62d4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d014c630 con 0x7f86d014b1f0 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 0x7f86d014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86cffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 0x7f86d014dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52094/0 (socket says 172.21.15.6:52094) 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86cffff640 1 -- 172.21.15.6:0/3987934760 learned_addr learned my addr 172.21.15.6:0/3987934760 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86cf7fe640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d00ba290 0x7f86d01e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.557+0000 7f86d4871640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d014b1f0 0x7f86d01e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86cffff640 1 -- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d014b1f0 msgr2=0x7f86d01e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86cffff640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d014b1f0 0x7f86d01e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86cffff640 1 -- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d00ba290 msgr2=0x7f86d01e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86cffff640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d00ba290 0x7f86d01e06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86cffff640 1 -- 172.21.15.6:0/3987934760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009a70 con 0x7f86d006d770 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86d4871640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d014b1f0 0x7f86d01e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86cffff640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 0x7f86d014dae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f86c000c430 tx=0x7f86c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0011790 con 0x7f86d006d770 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00118f0 con 0x7f86d006d770 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d014c970 con 0x7f86d006d770 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0011ca0 con 0x7f86d006d770 2023-12-19T13:33:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.558+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d0145630 con 0x7f86d006d770 2023-12-19T13:33:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.559+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d014c1b0 con 0x7f86d006d770 2023-12-19T13:33:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.559+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86c001c460 con 0x7f86d006d770 2023-12-19T13:33:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.560+0000 7f86ccff9640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86bc06a430 0x7f86bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.560+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86c00887b0 con 0x7f86d006d770 2023-12-19T13:33:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.560+0000 7f86cf7fe640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86bc06a430 0x7f86bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.560+0000 7f86cf7fe640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86bc06a430 0x7f86bc06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f86d0141420 tx=0x7f86c4007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.564+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86d014c1b0 con 0x7f86d006d770 2023-12-19T13:33:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.776+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f86d01e03c0 con 0x7f86d006d770 2023-12-19T13:33:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.776+0000 7f86ccff9640 1 -- 172.21.15.6:0/3987934760 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f86d01e03c0 con 0x7f86d006d770 2023-12-19T13:33:16.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:16.779 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T13:33:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86bc06a430 msgr2=0x7f86bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86bc06a430 0x7f86bc06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f86d0141420 tx=0x7f86c4007d50 comp rx=0 tx=0).stop 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 msgr2=0x7f86d014dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 0x7f86d014dae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f86c000c430 tx=0x7f86c000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 shutdown_connections 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86bc06a430 0x7f86bc06c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d014b1f0 0x7f86d01e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d00ba290 0x7f86d01e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 --2- 172.21.15.6:0/3987934760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d006d770 0x7f86d014dae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 >> 172.21.15.6:0/3987934760 conn(0x7f86d00bac30 msgr2=0x7f86d006f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 shutdown_connections 2023-12-19T13:33:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.778+0000 7f86d62d4640 1 -- 172.21.15.6:0/3987934760 wait complete. 2023-12-19T13:33:16.791 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T13:33:16.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 Processor -- start 2023-12-19T13:33:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 -- start start 2023-12-19T13:33:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d2806a6d0 0x7f0d2814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d280b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d280bb310 con 0x7f0d280ba550 2023-12-19T13:33:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280bf960 con 0x7f0d2806a6d0 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.896+0000 7f0d2ebf0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280bb5b0 con 0x7f0d2814b1f0 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d2d18d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0d280ba550 0x7f0d2814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57206/0 (socket says 172.21.15.6:57206) 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d2d18d640 1 -- 172.21.15.6:0/2316854595 learned_addr learned my addr 172.21.15.6:0/2316854595 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/2316854595 >> v2:172.21.15.89:3300/0 conn(0x7f0d2806a6d0 0x7f0d2814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d27fff640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d280b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834299589 0 0) 0x7f0d280bb310 con 0x7f0d280ba550 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d18003520 con 0x7f0d280ba550 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1230009431 0 0) 0x7f0d18003520 con 0x7f0d280ba550 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 msgr2=0x7f0d280b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d280b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 >> v2:172.21.15.89:3300/0 conn(0x7f0d2806a6d0 msgr2=0x7f0d2814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 --2- 172.21.15.6:0/2316854595 >> v2:172.21.15.89:3300/0 conn(0x7f0d2806a6d0 0x7f0d2814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d280c0120 con 0x7f0d280ba550 2023-12-19T13:33:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f0d200019f0 con 0x7f0d280ba550 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/2316854595 >> v2:172.21.15.89:3300/0 conn(0x7f0d2806a6d0 0x7f0d2814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 >> v1:172.21.15.6:6789/0 conn(0x7f0d280ba550 legacy=0x7f0d2814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d180047c0 0x7f0d18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280bf960 con 0x7f0d18003970 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280bb5b0 con 0x7f0d180047c0 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1800b980 con 0x7f0d2814b1f0 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d2d18d640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.897+0000 7f0d27fff640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d180047c0 0x7f0d18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2c98c640 1 -- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 msgr2=0x7f0d18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2c98c640 1 -- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d180047c0 msgr2=0x7f0d18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d180047c0 0x7f0d18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2c98c640 1 -- 172.21.15.6:0/2316854595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18003520 con 0x7f0d18003970 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d27fff640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d180047c0 0x7f0d18004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2d18d640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2814b1f0 0x7f0d18005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009c90 tx=0x7f0d180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f8e5f755a2eaf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c02c980 con 0x7f0d18003970 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c02cae0 con 0x7f0d18003970 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.898+0000 7f0d277fe640 1 -- 172.21.15.6:0/2316854595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c02ce90 con 0x7f0d18003970 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/2316854595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 msgr2=0x7f0d18003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/2316854595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d18003d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009c90 tx=0x7f0d180057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2d18d640 1 -- 172.21.15.6:0/2316854595 reap_dead start 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/2316854595 shutdown_connections 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/2316854595 >> 172.21.15.6:0/2316854595 conn(0x7f0d280c0350 msgr2=0x7f0d280c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/2316854595 shutdown_connections 2023-12-19T13:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.899+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/2316854595 wait complete. 2023-12-19T13:33:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.900+0000 7f0d2ebf0640 1 Processor -- start 2023-12-19T13:33:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.900+0000 7f0d2ebf0640 1 -- start start 2023-12-19T13:33:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2ebf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d28099560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2ebf0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2809efe0 0x7f0d2809e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2ebf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2809c380 0x7f0d2809cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2ebf0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2809d4e0 con 0x7f0d18003970 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2ebf0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2809f490 con 0x7f0d2809c380 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2ebf0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2809b8a0 con 0x7f0d2809efe0 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d28099560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d28099560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52108/0 (socket says 172.21.15.6:52108) 2023-12-19T13:33:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 -- 172.21.15.6:0/334027575 learned_addr learned my addr 172.21.15.6:0/334027575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2d18d640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2809c380 0x7f0d2809cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d27fff640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2809efe0 0x7f0d2809e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 -- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2809efe0 msgr2=0x7f0d2809e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2809efe0 0x7f0d2809e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 -- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2809c380 msgr2=0x7f0d2809cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2809c380 0x7f0d2809cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 -- 172.21.15.6:0/334027575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2809bb80 con 0x7f0d18003970 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.901+0000 7f0d2c98c640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d28099560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c037040 tx=0x7f0d1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.902+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c034a80 con 0x7f0d18003970 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.902+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c034c20 con 0x7f0d18003970 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.902+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2809be60 con 0x7f0d18003970 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.902+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c004020 con 0x7f0d18003970 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.902+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d28149f60 con 0x7f0d18003970 2023-12-19T13:33:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.903+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2809b700 con 0x7f0d18003970 2023-12-19T13:33:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.903+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d1c004180 con 0x7f0d18003970 2023-12-19T13:33:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.903+0000 7f0d257fa640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.903+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d1c0aac90 con 0x7f0d18003970 2023-12-19T13:33:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.904+0000 7f0d27fff640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.904+0000 7f0d27fff640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d2809f3c0 tx=0x7f0d14008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:16.908+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d2809b700 con 0x7f0d18003970 2023-12-19T13:33:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.086+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d2809b9e0 con 0x7f0d18003970 2023-12-19T13:33:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.087+0000 7f0d257fa640 1 -- 172.21.15.6:0/334027575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f0d2809b9e0 con 0x7f0d18003970 2023-12-19T13:33:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:17.090 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d0c06a430 msgr2=0x7f0d0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d2809f3c0 tx=0x7f0d14008040 comp rx=0 tx=0).stop 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 msgr2=0x7f0d28099560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d28099560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c037040 tx=0x7f0d1c004730 comp rx=0 tx=0).stop 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 shutdown_connections 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2809c380 0x7f0d2809cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d2809efe0 0x7f0d2809e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 --2- 172.21.15.6:0/334027575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d18003970 0x7f0d28099560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 >> 172.21.15.6:0/334027575 conn(0x7f0d280c0350 msgr2=0x7f0d280be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 shutdown_connections 2023-12-19T13:33:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.089+0000 7f0d2ebf0640 1 -- 172.21.15.6:0/334027575 wait complete. 2023-12-19T13:33:17.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:17.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.208+0000 7fe8be2df640 1 Processor -- start 2023-12-19T13:33:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.208+0000 7fe8be2df640 1 -- start start 2023-12-19T13:33:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8be2df640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8b80b8690 0x7fe8b80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8be2df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8b80b77d0 0x7fe8b8144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8be2df640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b8144bb0 0x7fe8b814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8be2df640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b814ab10 con 0x7fe8b80b8690 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8be2df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b806c2f0 con 0x7fe8b80b77d0 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8be2df640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80ba620 con 0x7fe8b8144bb0 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8b80b8690 0x7fe8b80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8b80b8690 0x7fe8b80b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52118/0 (socket says 172.21.15.6:52118) 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 -- 172.21.15.6:0/1550935592 learned_addr learned my addr 172.21.15.6:0/1550935592 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8bc87c640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b8144bb0 0x7fe8b814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b77fe640 1 --2- 172.21.15.6:0/1550935592 >> v2:172.21.15.89:3300/0 conn(0x7fe8b80b77d0 0x7fe8b8144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 -- 172.21.15.6:0/1550935592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b8144bb0 msgr2=0x7fe8b814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b8144bb0 0x7fe8b814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 -- 172.21.15.6:0/1550935592 >> v2:172.21.15.89:3300/0 conn(0x7fe8b80b77d0 msgr2=0x7fe8b8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 --2- 172.21.15.6:0/1550935592 >> v2:172.21.15.89:3300/0 conn(0x7fe8b80b77d0 0x7fe8b8144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b7fff640 1 -- 172.21.15.6:0/1550935592 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80b9e60 con 0x7fe8b80b8690 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8b77fe640 1 --2- 172.21.15.6:0/1550935592 >> v2:172.21.15.89:3300/0 conn(0x7fe8b80b77d0 0x7fe8b8144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.209+0000 7fe8bc87c640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b8144bb0 0x7fe8b814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.210+0000 7fe8b7fff640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b80b8690 0x7fe8b80b8a70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8b806ae90 tx=0x7fe8ac02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1c974fabb323a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.210+0000 7fe8b6ffd640 1 -- 172.21.15.6:0/1550935592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0317d0 con 0x7fe8b80b8690 2023-12-19T13:33:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.210+0000 7fe8b6ffd640 1 -- 172.21.15.6:0/1550935592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac031930 con 0x7fe8b80b8690 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.210+0000 7fe8b6ffd640 1 -- 172.21.15.6:0/1550935592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac031cc0 con 0x7fe8b80b8690 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 -- 172.21.15.6:0/1550935592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b80b8690 msgr2=0x7fe8b80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b80b8690 0x7fe8b80b8a70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8b806ae90 tx=0x7fe8ac02b870 comp rx=0 tx=0).stop 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 -- 172.21.15.6:0/1550935592 shutdown_connections 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b8144bb0 0x7fe8b814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 --2- 172.21.15.6:0/1550935592 >> v2:172.21.15.89:3300/0 conn(0x7fe8b80b77d0 0x7fe8b8144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 --2- 172.21.15.6:0/1550935592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b80b8690 0x7fe8b80b8a70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 -- 172.21.15.6:0/1550935592 >> 172.21.15.6:0/1550935592 conn(0x7fe8b806b6a0 msgr2=0x7fe8b806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 -- 172.21.15.6:0/1550935592 shutdown_connections 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.211+0000 7fe8be2df640 1 -- 172.21.15.6:0/1550935592 wait complete. 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.212+0000 7fe8be2df640 1 Processor -- start 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.212+0000 7fe8be2df640 1 -- start start 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8be2df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b80b77d0 0x7fe8b8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8be2df640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b80b8690 0x7fe8b814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8be2df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 0x7fe8b8145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8be2df640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81495d0 con 0x7fe8b8144bb0 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8be2df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b814a660 con 0x7fe8b80b77d0 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8be2df640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81473a0 con 0x7fe8b80b8690 2023-12-19T13:33:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 0x7fe8b8145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b80b77d0 0x7fe8b8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 0x7fe8b8145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52124/0 (socket says 172.21.15.6:52124) 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8b77fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b80b8690 0x7fe8b814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 -- 172.21.15.6:0/923608308 learned_addr learned my addr 172.21.15.6:0/923608308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b80b77d0 0x7fe8b8147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:54532/0 (socket says 172.21.15.6:54532) 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 -- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b80b8690 msgr2=0x7fe8b814a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b80b8690 0x7fe8b814a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 -- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b80b77d0 msgr2=0x7fe8b8147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b80b77d0 0x7fe8b8147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 -- 172.21.15.6:0/923608308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0094d0 con 0x7fe8b8144bb0 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.213+0000 7fe8bc87c640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 0x7fe8b8145800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000cd50 tx=0x7fe8b000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.214+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000f680 con 0x7fe8b8144bb0 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.214+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b000f800 con 0x7fe8b8144bb0 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.214+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b8145d40 con 0x7fe8b8144bb0 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.214+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000fbb0 con 0x7fe8b8144bb0 2023-12-19T13:33:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.214+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b81497b0 con 0x7fe8b8144bb0 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.215+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b8073a40 con 0x7fe8b8144bb0 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.215+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe8b000b040 con 0x7fe8b8144bb0 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.215+0000 7fe8b4ff9640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe8a406a430 0x7fe8a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.216+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8b00891c0 con 0x7fe8b8144bb0 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.216+0000 7fe8b7fff640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe8a406a430 0x7fe8a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.216+0000 7fe8b7fff640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe8a406a430 0x7fe8a406c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac036000 tx=0x7fe8ac03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.220+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe8b0054850 con 0x7fe8b8144bb0 2023-12-19T13:33:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.395+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8b8148be0 con 0x7fe8b8144bb0 2023-12-19T13:33:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.395+0000 7fe8b4ff9640 1 -- 172.21.15.6:0/923608308 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8b0057e70 con 0x7fe8b8144bb0 2023-12-19T13:33:17.397 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe8a406a430 msgr2=0x7fe8a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe8a406a430 0x7fe8a406c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac036000 tx=0x7fe8ac03d040 comp rx=0 tx=0).stop 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 msgr2=0x7fe8b8145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 0x7fe8b8145800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000cd50 tx=0x7fe8b000a650 comp rx=0 tx=0).stop 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 shutdown_connections 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe8a406a430 0x7fe8a406c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8b8144bb0 0x7fe8b8145800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8b80b8690 0x7fe8b814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 --2- 172.21.15.6:0/923608308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8b80b77d0 0x7fe8b8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 >> 172.21.15.6:0/923608308 conn(0x7fe8b806b6a0 msgr2=0x7fe8b8144490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 shutdown_connections 2023-12-19T13:33:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.397+0000 7fe8be2df640 1 -- 172.21.15.6:0/923608308 wait complete. 2023-12-19T13:33:17.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.517+0000 7ffb18138640 1 Processor -- start 2023-12-19T13:33:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.517+0000 7ffb18138640 1 -- start start 2023-12-19T13:33:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb18138640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb100b8690 0x7ffb100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb18138640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb100b77d0 0x7ffb10144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb18138640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1014ab10 con 0x7ffb10144bb0 2023-12-19T13:33:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb18138640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1006c2f0 con 0x7ffb100b8690 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb18138640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100ba620 con 0x7ffb100b77d0 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb100b8690 0x7ffb100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb100b8690 0x7ffb100b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52132/0 (socket says 172.21.15.6:52132) 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 -- 172.21.15.6:0/2950554475 learned_addr learned my addr 172.21.15.6:0/2950554475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb156d3640 1 --2- 172.21.15.6:0/2950554475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb100b77d0 0x7ffb10144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 -- 172.21.15.6:0/2950554475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb100b77d0 msgr2=0x7ffb10144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 --2- 172.21.15.6:0/2950554475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb100b77d0 0x7ffb10144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 -- 172.21.15.6:0/2950554475 >> v1:172.21.15.89:6789/0 conn(0x7ffb10144bb0 legacy=0x7ffb1014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.518+0000 7ffb15ed4640 1 -- 172.21.15.6:0/2950554475 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100b9e60 con 0x7ffb100b8690 2023-12-19T13:33:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.519+0000 7ffb15ed4640 1 --2- 172.21.15.6:0/2950554475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb100b8a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009870 tx=0x7ffb0c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a2f40f6dffda72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.519+0000 7ffb14ed2640 1 -- 172.21.15.6:0/2950554475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c031640 con 0x7ffb100b8690 2023-12-19T13:33:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.519+0000 7ffb14ed2640 1 -- 172.21.15.6:0/2950554475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c0317a0 con 0x7ffb100b8690 2023-12-19T13:33:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.519+0000 7ffb14ed2640 1 -- 172.21.15.6:0/2950554475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c031b30 con 0x7ffb100b8690 2023-12-19T13:33:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 -- 172.21.15.6:0/2950554475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 msgr2=0x7ffb100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 --2- 172.21.15.6:0/2950554475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb100b8a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009870 tx=0x7ffb0c02b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 -- 172.21.15.6:0/2950554475 shutdown_connections 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 --2- 172.21.15.6:0/2950554475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb100b77d0 0x7ffb10144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 --2- 172.21.15.6:0/2950554475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb100b8a70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 -- 172.21.15.6:0/2950554475 >> 172.21.15.6:0/2950554475 conn(0x7ffb1006b6a0 msgr2=0x7ffb1006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 -- 172.21.15.6:0/2950554475 shutdown_connections 2023-12-19T13:33:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.520+0000 7ffb18138640 1 -- 172.21.15.6:0/2950554475 wait complete. 2023-12-19T13:33:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 Processor -- start 2023-12-19T13:33:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 -- start start 2023-12-19T13:33:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb100b77d0 0x7ffb101d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb101d7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb10144bb0 0x7ffb1013c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1014a780 con 0x7ffb100b8690 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101d1ee0 con 0x7ffb100b77d0 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.521+0000 7ffb18138640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101d7a60 con 0x7ffb10144bb0 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb101d7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb101d7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52142/0 (socket says 172.21.15.6:52142) 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 -- 172.21.15.6:0/3155847792 learned_addr learned my addr 172.21.15.6:0/3155847792 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb15ed4640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb100b77d0 0x7ffb101d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb166d5640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb10144bb0 0x7ffb1013c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 -- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb10144bb0 msgr2=0x7ffb1013c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb10144bb0 0x7ffb1013c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 -- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb100b77d0 msgr2=0x7ffb101d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb100b77d0 0x7ffb101d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 -- 172.21.15.6:0/3155847792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0094d0 con 0x7ffb100b8690 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb156d3640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb101d7520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000e9b0 tx=0x7ffb0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00009670 con 0x7ffb100b8690 2023-12-19T13:33:17.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0000c9a0 con 0x7ffb100b8690 2023-12-19T13:33:17.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000cd50 con 0x7ffb100b8690 2023-12-19T13:33:17.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb10149ea0 con 0x7ffb100b8690 2023-12-19T13:33:17.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.522+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb101d0d20 con 0x7ffb100b8690 2023-12-19T13:33:17.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.523+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb101d0eb0 con 0x7ffb100b8690 2023-12-19T13:33:17.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.524+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb00013470 con 0x7ffb100b8690 2023-12-19T13:33:17.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.524+0000 7ffb067fc640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ffaf406a430 0x7ffaf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.524+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb00088b40 con 0x7ffb100b8690 2023-12-19T13:33:17.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.524+0000 7ffb15ed4640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ffaf406a430 0x7ffaf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.525+0000 7ffb15ed4640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ffaf406a430 0x7ffaf406c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c036000 tx=0x7ffb0c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.528+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb000541d0 con 0x7ffb100b8690 2023-12-19T13:33:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.705+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb10073a40 con 0x7ffb100b8690 2023-12-19T13:33:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.705+0000 7ffb067fc640 1 -- 172.21.15.6:0/3155847792 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb00017020 con 0x7ffb100b8690 2023-12-19T13:33:17.707 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ffaf406a430 msgr2=0x7ffaf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ffaf406a430 0x7ffaf406c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c036000 tx=0x7ffb0c03c040 comp rx=0 tx=0).stop 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 msgr2=0x7ffb101d7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb101d7520 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000e9b0 tx=0x7ffb0000ee70 comp rx=0 tx=0).stop 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 shutdown_connections 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ffaf406a430 0x7ffaf406c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb10144bb0 0x7ffb1013c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb100b8690 0x7ffb101d7520 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 --2- 172.21.15.6:0/3155847792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb100b77d0 0x7ffb101d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 >> 172.21.15.6:0/3155847792 conn(0x7ffb1006b6a0 msgr2=0x7ffb100ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 shutdown_connections 2023-12-19T13:33:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.707+0000 7ffb18138640 1 -- 172.21.15.6:0/3155847792 wait complete. 2023-12-19T13:33:17.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.826+0000 7fe60feec640 1 Processor -- start 2023-12-19T13:33:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.826+0000 7fe60feec640 1 -- start start 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60feec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 0x7fe6080a2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60feec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe608071b30 0x7fe6081531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60feec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080b9950 con 0x7fe608070130 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60feec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080b9760 con 0x7fe608071b30 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60feec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe608070a40 con 0x7fe608069d00 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60e489640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe608071b30 0x7fe6081531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60d487640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 0x7fe6080a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60d487640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 0x7fe6080a2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:55246/0 (socket says 172.21.15.6:55246) 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60e489640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe608071b30 0x7fe6081531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:54562/0 (socket says 172.21.15.6:54562) 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60d487640 1 -- 172.21.15.6:0/2397377855 learned_addr learned my addr 172.21.15.6:0/2397377855 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.827+0000 7fe60dc88640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe608070130 0x7fe608149300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59024/0 (socket says 172.21.15.6:59024) 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.828+0000 7fe60d487640 1 -- 172.21.15.6:0/2397377855 >> v2:172.21.15.89:3300/0 conn(0x7fe608071b30 msgr2=0x7fe6081531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.828+0000 7fe60d487640 1 --2- 172.21.15.6:0/2397377855 >> v2:172.21.15.89:3300/0 conn(0x7fe608071b30 0x7fe6081531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.828+0000 7fe60d487640 1 -- 172.21.15.6:0/2397377855 >> v1:172.21.15.89:6789/0 conn(0x7fe608070130 legacy=0x7fe608149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.828+0000 7fe60d487640 1 -- 172.21.15.6:0/2397377855 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080b9480 con 0x7fe608069d00 2023-12-19T13:33:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60d487640 1 --2- 172.21.15.6:0/2397377855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 0x7fe6080a2790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4b6a5039350208 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60cc86640 1 -- 172.21.15.6:0/2397377855 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc030840 con 0x7fe608069d00 2023-12-19T13:33:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60cc86640 1 -- 172.21.15.6:0/2397377855 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc0309a0 con 0x7fe608069d00 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60cc86640 1 -- 172.21.15.6:0/2397377855 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc030d30 con 0x7fe608069d00 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 -- 172.21.15.6:0/2397377855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 msgr2=0x7fe6080a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 --2- 172.21.15.6:0/2397377855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 0x7fe6080a2790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02b980 comp rx=0 tx=0).stop 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 -- 172.21.15.6:0/2397377855 shutdown_connections 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 --2- 172.21.15.6:0/2397377855 >> v2:172.21.15.89:3300/0 conn(0x7fe608071b30 0x7fe6081531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 --2- 172.21.15.6:0/2397377855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608069d00 0x7fe6080a2790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 -- 172.21.15.6:0/2397377855 >> 172.21.15.6:0/2397377855 conn(0x7fe60806ae10 msgr2=0x7fe60806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 -- 172.21.15.6:0/2397377855 shutdown_connections 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.829+0000 7fe60feec640 1 -- 172.21.15.6:0/2397377855 wait complete. 2023-12-19T13:33:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.830+0000 7fe60feec640 1 Processor -- start 2023-12-19T13:33:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.830+0000 7fe60feec640 1 -- start start 2023-12-19T13:33:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60feec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 0x7fe608147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60feec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608070130 0x7fe60813b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60feec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe608071b30 0x7fe60813ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60feec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081419d0 con 0x7fe608069d00 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60feec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608147e70 con 0x7fe608071b30 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60feec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081416f0 con 0x7fe608070130 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 0x7fe608147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 0x7fe608147930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52154/0 (socket says 172.21.15.6:52154) 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 -- 172.21.15.6:0/464785937 learned_addr learned my addr 172.21.15.6:0/464785937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60d487640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608070130 0x7fe60813b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60e489640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe608071b30 0x7fe60813ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 -- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608070130 msgr2=0x7fe60813b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608070130 0x7fe60813b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 -- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe608071b30 msgr2=0x7fe60813ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.831+0000 7fe60dc88640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe608071b30 0x7fe60813ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe60dc88640 1 -- 172.21.15.6:0/464785937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0094d0 con 0x7fe608069d00 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe60dc88640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 0x7fe608147930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe60000c800 tx=0x7fe60000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000a5e0 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000a740 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6080b5560 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000aab0 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.832+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60813f010 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.833+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608066e10 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.833+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe60000ac10 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.834+0000 7fe6067fc640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.834+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe600088050 con 0x7fe608069d00 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.834+0000 7fe60d487640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.834+0000 7fe60d487640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc036000 tx=0x7fe5fc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:17.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:17.838+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe600053670 con 0x7fe608069d00 2023-12-19T13:33:18.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.012+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6080b53c0 con 0x7fe608069d00 2023-12-19T13:33:18.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.012+0000 7fe6067fc640 1 -- 172.21.15.6:0/464785937 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6080b53c0 con 0x7fe608069d00 2023-12-19T13:33:18.014 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 msgr2=0x7fe5f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc036000 tx=0x7fe5fc008030 comp rx=0 tx=0).stop 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 msgr2=0x7fe608147930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 0x7fe608147930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe60000c800 tx=0x7fe60000ccc0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 shutdown_connections 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe608071b30 0x7fe60813ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe608070130 0x7fe60813b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 --2- 172.21.15.6:0/464785937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe608069d00 0x7fe608147930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 >> 172.21.15.6:0/464785937 conn(0x7fe60806ae10 msgr2=0x7fe6080a0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 shutdown_connections 2023-12-19T13:33:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.014+0000 7fe60feec640 1 -- 172.21.15.6:0/464785937 wait complete. 2023-12-19T13:33:18.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f8f070640 1 Processor -- start 2023-12-19T13:33:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f8f070640 1 -- start start 2023-12-19T13:33:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f8f070640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f881544e0 0x7f4f881568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f8f070640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f880bb310 con 0x7f4f880ba550 2023-12-19T13:33:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f8f070640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f880bf960 con 0x7f4f8806a6d0 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f8f070640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880bb5b0 con 0x7f4f881544e0 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f87fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f880ba550 0x7f4f880b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57214/0 (socket says 172.21.15.6:57214) 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.130+0000 7f4f87fff640 1 -- 172.21.15.6:0/1780724902 learned_addr learned my addr 172.21.15.6:0/1780724902 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f8d60d640 1 --2- 172.21.15.6:0/1780724902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f881544e0 0x7f4f881568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516843150 0 0) 0x7f4f880bb310 con 0x7f4f880ba550 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f70003520 con 0x7f4f880ba550 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425113071 0 0) 0x7f4f880bf960 con 0x7f4f8806a6d0 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f880bb310 con 0x7f4f8806a6d0 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1780724902 >> v1:172.21.15.89:6789/0 conn(0x7f4f8806a6d0 legacy=0x7f4f8814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1780724902 >> v1:172.21.15.6:6789/0 conn(0x7f4f880ba550 legacy=0x7f4f880b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.131+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1780724902 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880c0120 con 0x7f4f881544e0 2023-12-19T13:33:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8d60d640 1 --2- 172.21.15.6:0/1780724902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f881544e0 0x7f4f881568d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f780097d0 tx=0x7f4f7802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c464ed676aabaeb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78031890 con 0x7f4f881544e0 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f780319f0 con 0x7f4f881544e0 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f877fe640 1 -- 172.21.15.6:0/1780724902 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78031d80 con 0x7f4f881544e0 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 -- 172.21.15.6:0/1780724902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f881544e0 msgr2=0x7f4f881568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1780724902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f881544e0 0x7f4f881568d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f780097d0 tx=0x7f4f7802b930 comp rx=0 tx=0).stop 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 -- 172.21.15.6:0/1780724902 shutdown_connections 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1780724902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f881544e0 0x7f4f881568d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 -- 172.21.15.6:0/1780724902 >> 172.21.15.6:0/1780724902 conn(0x7f4f880c0350 msgr2=0x7f4f880c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 -- 172.21.15.6:0/1780724902 shutdown_connections 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.132+0000 7f4f8f070640 1 -- 172.21.15.6:0/1780724902 wait complete. 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.133+0000 7f4f8f070640 1 Processor -- start 2023-12-19T13:33:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.133+0000 7f4f8f070640 1 -- start start 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8f070640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f8806a6d0 0x7f4f880b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8f070640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f880ba550 0x7f4f881d9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8f070640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 0x7f4f881d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8f070640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881e40f0 con 0x7f4f881544e0 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8f070640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88146de0 con 0x7f4f880ba550 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8f070640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881e37c0 con 0x7f4f8806a6d0 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8d60d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 0x7f4f881d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8d60d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 0x7f4f881d9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52166/0 (socket says 172.21.15.6:52166) 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.134+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1632894484 learned_addr learned my addr 172.21.15.6:0/1632894484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f87fff640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f880ba550 0x7f4f881d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8ce0c640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f8806a6d0 0x7f4f880b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f8806a6d0 msgr2=0x7f4f880b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8d60d640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f8806a6d0 0x7f4f880b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f880ba550 msgr2=0x7f4f881d9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8d60d640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f880ba550 0x7f4f881d9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8d60d640 1 -- 172.21.15.6:0/1632894484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78009400 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8ce0c640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f8806a6d0 0x7f4f880b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8d60d640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 0x7f4f881d9ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f780097d0 tx=0x7f4f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7803bb70 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7803bcd0 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78045630 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f881e3aa0 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.135+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f88154240 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.136+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f880be840 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.136+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f7804e450 con 0x7f4f881544e0 2023-12-19T13:33:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.137+0000 7f4f857fa640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4f7406a460 0x7f4f7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.137+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f780aafa0 con 0x7f4f881544e0 2023-12-19T13:33:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.137+0000 7f4f8ce0c640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4f7406a460 0x7f4f7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.137+0000 7f4f8ce0c640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4f7406a460 0x7f4f7406c920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f80007fd0 tx=0x7f4f80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.141+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f78076470 con 0x7f4f881544e0 2023-12-19T13:33:18.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.352+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f88073a40 con 0x7f4f881544e0 2023-12-19T13:33:18.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.353+0000 7f4f857fa640 1 -- 172.21.15.6:0/1632894484 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f4f78079a90 con 0x7f4f881544e0 2023-12-19T13:33:18.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:18.355 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:18.355 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4f7406a460 msgr2=0x7f4f7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4f7406a460 0x7f4f7406c920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f80007fd0 tx=0x7f4f80009040 comp rx=0 tx=0).stop 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 msgr2=0x7f4f881d9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 0x7f4f881d9ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f780097d0 tx=0x7f4f780046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 shutdown_connections 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4f7406a460 0x7f4f7406c920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f881544e0 0x7f4f881d9ba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f880ba550 0x7f4f881d9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 --2- 172.21.15.6:0/1632894484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f8806a6d0 0x7f4f880b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 >> 172.21.15.6:0/1632894484 conn(0x7f4f880c0350 msgr2=0x7f4f880be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 shutdown_connections 2023-12-19T13:33:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.354+0000 7f4f8f070640 1 -- 172.21.15.6:0/1632894484 wait complete. 2023-12-19T13:33:18.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.471+0000 7f6e25dd3640 1 Processor -- start 2023-12-19T13:33:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.471+0000 7f6e25dd3640 1 -- start start 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e25dd3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e200ba550 0x7f6e200b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e25dd3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e200ba000 0x7f6e201554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e25dd3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e200bb310 con 0x7f6e2006a6d0 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e25dd3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e200bf960 con 0x7f6e200ba550 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e25dd3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e200bb5b0 con 0x7f6e200ba000 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e200ba550 0x7f6e200b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e200ba550 0x7f6e200b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52182/0 (socket says 172.21.15.6:52182) 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 -- 172.21.15.6:0/1004641587 learned_addr learned my addr 172.21.15.6:0/1004641587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1ffff640 1 --2- 172.21.15.6:0/1004641587 >> v2:172.21.15.89:3300/0 conn(0x7f6e200ba000 0x7f6e201554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 -- 172.21.15.6:0/1004641587 >> v2:172.21.15.89:3300/0 conn(0x7f6e200ba000 msgr2=0x7f6e201554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 --2- 172.21.15.6:0/1004641587 >> v2:172.21.15.89:3300/0 conn(0x7f6e200ba000 0x7f6e201554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 -- 172.21.15.6:0/1004641587 >> v1:172.21.15.89:6789/0 conn(0x7f6e2006a6d0 legacy=0x7f6e2014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1effd640 1 -- 172.21.15.6:0/1004641587 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200c0120 con 0x7f6e200ba550 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.472+0000 7f6e1ffff640 1 --2- 172.21.15.6:0/1004641587 >> v2:172.21.15.89:3300/0 conn(0x7f6e200ba000 0x7f6e201554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.473+0000 7f6e1effd640 1 --2- 172.21.15.6:0/1004641587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e200ba550 0x7f6e200b9ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e2009fcb0 tx=0x7f6e1402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9854baad65f614 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.473+0000 7f6e1e7fc640 1 -- 172.21.15.6:0/1004641587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14030860 con 0x7f6e200ba550 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.473+0000 7f6e1e7fc640 1 -- 172.21.15.6:0/1004641587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e140309c0 con 0x7f6e200ba550 2023-12-19T13:33:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.473+0000 7f6e1e7fc640 1 -- 172.21.15.6:0/1004641587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14030d50 con 0x7f6e200ba550 2023-12-19T13:33:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 -- 172.21.15.6:0/1004641587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e200ba550 msgr2=0x7f6e200b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/1004641587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e200ba550 0x7f6e200b9ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e2009fcb0 tx=0x7f6e1402b9a0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 -- 172.21.15.6:0/1004641587 shutdown_connections 2023-12-19T13:33:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/1004641587 >> v2:172.21.15.89:3300/0 conn(0x7f6e200ba000 0x7f6e201554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/1004641587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e200ba550 0x7f6e200b9ac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 -- 172.21.15.6:0/1004641587 >> 172.21.15.6:0/1004641587 conn(0x7f6e200c0350 msgr2=0x7f6e200c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 -- 172.21.15.6:0/1004641587 shutdown_connections 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.474+0000 7f6e25dd3640 1 -- 172.21.15.6:0/1004641587 wait complete. 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.475+0000 7f6e25dd3640 1 Processor -- start 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.475+0000 7f6e25dd3640 1 -- start start 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.475+0000 7f6e25dd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 0x7f6e20147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.475+0000 7f6e25dd3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e200ba000 0x7f6e201e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.475+0000 7f6e25dd3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e200ba550 0x7f6e200b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e25dd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201e4690 con 0x7f6e2006a6d0 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e25dd3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2014ecd0 con 0x7f6e200ba550 2023-12-19T13:33:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e25dd3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201e4200 con 0x7f6e200ba000 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 0x7f6e20147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 0x7f6e20147070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52192/0 (socket says 172.21.15.6:52192) 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 -- 172.21.15.6:0/553273174 learned_addr learned my addr 172.21.15.6:0/553273174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1ffff640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e200ba550 0x7f6e200b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1effd640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e200ba000 0x7f6e201e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 -- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e200ba000 msgr2=0x7f6e201e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e200ba000 0x7f6e201e39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 -- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e200ba550 msgr2=0x7f6e200b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e200ba550 0x7f6e200b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 -- 172.21.15.6:0/553273174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140094d0 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1ffff640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e200ba550 0x7f6e200b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e1f7fe640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 0x7f6e20147070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c480 tx=0x7f6e1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e100052d0 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10005430 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e201e3f00 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10012870 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.476+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e20147780 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.477+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e200be840 con 0x7f6e2006a6d0 2023-12-19T13:33:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.478+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e100129d0 con 0x7f6e2006a6d0 2023-12-19T13:33:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.478+0000 7f6e07fff640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6e0c06a430 0x7f6e0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.478+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e100883a0 con 0x7f6e2006a6d0 2023-12-19T13:33:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.478+0000 7f6e1effd640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6e0c06a430 0x7f6e0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.479+0000 7f6e1effd640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6e0c06a430 0x7f6e0c06c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6e14036000 tx=0x7f6e1403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.482+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6e10053a20 con 0x7f6e2006a6d0 2023-12-19T13:33:18.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.660+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e2014b3c0 con 0x7f6e2006a6d0 2023-12-19T13:33:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.661+0000 7f6e07fff640 1 -- 172.21.15.6:0/553273174 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f6e10057040 con 0x7f6e2006a6d0 2023-12-19T13:33:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:18.663 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6e0c06a430 msgr2=0x7f6e0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6e0c06a430 0x7f6e0c06c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6e14036000 tx=0x7f6e1403b040 comp rx=0 tx=0).stop 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 msgr2=0x7f6e20147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 0x7f6e20147070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c480 tx=0x7f6e1000c940 comp rx=0 tx=0).stop 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 shutdown_connections 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6e0c06a430 0x7f6e0c06c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e200ba550 0x7f6e200b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e200ba000 0x7f6e201e39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 --2- 172.21.15.6:0/553273174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2006a6d0 0x7f6e20147070 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 >> 172.21.15.6:0/553273174 conn(0x7f6e200c0350 msgr2=0x7f6e200be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 shutdown_connections 2023-12-19T13:33:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.663+0000 7f6e25dd3640 1 -- 172.21.15.6:0/553273174 wait complete. 2023-12-19T13:33:18.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:18.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:18.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.783+0000 7f0e5c392640 1 Processor -- start 2023-12-19T13:33:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.783+0000 7f0e5c392640 1 -- start start 2023-12-19T13:33:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5c392640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e540b8690 0x7f0e540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5c392640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e540b77d0 0x7f0e54144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5c392640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e5414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5c392640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5414ab10 con 0x7f0e540b77d0 2023-12-19T13:33:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5c392640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5406c2f0 con 0x7f0e540b8690 2023-12-19T13:33:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5c392640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540ba620 con 0x7f0e54144bb0 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5992d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e540b77d0 0x7f0e54144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5992d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e540b77d0 0x7f0e54144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52208/0 (socket says 172.21.15.6:52208) 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.784+0000 7f0e5992d640 1 -- 172.21.15.6:0/10417966 learned_addr learned my addr 172.21.15.6:0/10417966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5a12e640 1 --2- 172.21.15.6:0/10417966 >> v2:172.21.15.89:3300/0 conn(0x7f0e540b8690 0x7f0e540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5992d640 1 -- 172.21.15.6:0/10417966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 msgr2=0x7f0e5414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5a92f640 1 --2- 172.21.15.6:0/10417966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e5414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5992d640 1 --2- 172.21.15.6:0/10417966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e5414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5992d640 1 -- 172.21.15.6:0/10417966 >> v2:172.21.15.89:3300/0 conn(0x7f0e540b8690 msgr2=0x7f0e540b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5992d640 1 --2- 172.21.15.6:0/10417966 >> v2:172.21.15.89:3300/0 conn(0x7f0e540b8690 0x7f0e540b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5992d640 1 -- 172.21.15.6:0/10417966 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540b9e60 con 0x7f0e540b77d0 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.785+0000 7f0e5a12e640 1 --2- 172.21.15.6:0/10417966 >> v2:172.21.15.89:3300/0 conn(0x7f0e540b8690 0x7f0e540b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5992d640 1 --2- 172.21.15.6:0/10417966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e54144670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e5406aca0 tx=0x7f0e4402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df002cd50d01ab73 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5912c640 1 -- 172.21.15.6:0/10417966 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440317e0 con 0x7f0e540b77d0 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5912c640 1 -- 172.21.15.6:0/10417966 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44031940 con 0x7f0e540b77d0 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5912c640 1 -- 172.21.15.6:0/10417966 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44031cd0 con 0x7f0e540b77d0 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 -- 172.21.15.6:0/10417966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 msgr2=0x7f0e54144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 --2- 172.21.15.6:0/10417966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e54144670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e5406aca0 tx=0x7f0e4402b880 comp rx=0 tx=0).stop 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 -- 172.21.15.6:0/10417966 shutdown_connections 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 --2- 172.21.15.6:0/10417966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e5414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 --2- 172.21.15.6:0/10417966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e54144670 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 --2- 172.21.15.6:0/10417966 >> v2:172.21.15.89:3300/0 conn(0x7f0e540b8690 0x7f0e540b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 -- 172.21.15.6:0/10417966 >> 172.21.15.6:0/10417966 conn(0x7f0e5406b6a0 msgr2=0x7f0e5406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 -- 172.21.15.6:0/10417966 shutdown_connections 2023-12-19T13:33:18.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.786+0000 7f0e5c392640 1 -- 172.21.15.6:0/10417966 wait complete. 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.787+0000 7f0e5c392640 1 Processor -- start 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.787+0000 7f0e5c392640 1 -- start start 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5c392640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e5414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5c392640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e540b8690 0x7f0e541dfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5c392640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e54148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5c392640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5414a8c0 con 0x7f0e540b77d0 2023-12-19T13:33:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5c392640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541d7490 con 0x7f0e540b8690 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5c392640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54149e20 con 0x7f0e54144bb0 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e5414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e5414a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52222/0 (socket says 172.21.15.6:52222) 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 -- 172.21.15.6:0/1670785865 learned_addr learned my addr 172.21.15.6:0/1670785865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5992d640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e540b8690 0x7f0e541dfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a92f640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e54148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 -- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 msgr2=0x7f0e54148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e54148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 -- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e540b8690 msgr2=0x7f0e541dfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e540b8690 0x7f0e541dfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a12e640 1 -- 172.21.15.6:0/1670785865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440094d0 con 0x7f0e540b77d0 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5992d640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e540b8690 0x7f0e541dfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.788+0000 7f0e5a92f640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e54148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.789+0000 7f0e5a12e640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e5414a380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c7c0 tx=0x7f0e5000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.789+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50007a30 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.789+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50007b90 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.789+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e541e03c0 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.789+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000ce70 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.789+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e541e06a0 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.790+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e54073a40 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.790+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e500113f0 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.791+0000 7f0e4affd640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0e3806a430 0x7f0e3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.791+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e50088a90 con 0x7f0e540b77d0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.791+0000 7f0e5992d640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0e3806a430 0x7f0e3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.791+0000 7f0e5992d640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0e3806a430 0x7f0e3806c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e44036000 tx=0x7f0e4403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.795+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0e50054080 con 0x7f0e540b77d0 2023-12-19T13:33:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.970+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e540b7fc0 con 0x7f0e540b77d0 2023-12-19T13:33:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.970+0000 7f0e4affd640 1 -- 172.21.15.6:0/1670785865 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e5001f0a0 con 0x7f0e540b77d0 2023-12-19T13:33:18.973 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0e3806a430 msgr2=0x7f0e3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0e3806a430 0x7f0e3806c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e44036000 tx=0x7f0e4403d040 comp rx=0 tx=0).stop 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 msgr2=0x7f0e5414a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e5414a380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c7c0 tx=0x7f0e5000cc80 comp rx=0 tx=0).stop 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 shutdown_connections 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0e3806a430 0x7f0e3806c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e54144bb0 0x7f0e54148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e540b8690 0x7f0e541dfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 --2- 172.21.15.6:0/1670785865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e540b77d0 0x7f0e5414a380 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 >> 172.21.15.6:0/1670785865 conn(0x7f0e5406b6a0 msgr2=0x7f0e54142300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 shutdown_connections 2023-12-19T13:33:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:18.972+0000 7f0e5c392640 1 -- 172.21.15.6:0/1670785865 wait complete. 2023-12-19T13:33:18.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.091+0000 7f80c1f3c640 1 Processor -- start 2023-12-19T13:33:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.091+0000 7f80c1f3c640 1 -- start start 2023-12-19T13:33:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80c1f3c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80bc0b8690 0x7f80bc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80c1f3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc0b77d0 0x7f80bc144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80c1f3c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80bc144bb0 0x7f80bc14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80c1f3c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc14ab10 con 0x7f80bc144bb0 2023-12-19T13:33:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80c1f3c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc06c2f0 con 0x7f80bc0b8690 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80c1f3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0ba620 con 0x7f80bc0b77d0 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80bc144bb0 0x7f80bc14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80bc144bb0 0x7f80bc14afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52234/0 (socket says 172.21.15.6:52234) 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 -- 172.21.15.6:0/113764852 learned_addr learned my addr 172.21.15.6:0/113764852 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/113764852 >> v2:172.21.15.89:3300/0 conn(0x7f80bc0b8690 0x7f80bc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80baffd640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc0b77d0 0x7f80bc144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 -- 172.21.15.6:0/113764852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc0b77d0 msgr2=0x7f80bc144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc0b77d0 0x7f80bc144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 -- 172.21.15.6:0/113764852 >> v2:172.21.15.89:3300/0 conn(0x7f80bc0b8690 msgr2=0x7f80bc0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 --2- 172.21.15.6:0/113764852 >> v2:172.21.15.89:3300/0 conn(0x7f80bc0b8690 0x7f80bc0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80bbfff640 1 -- 172.21.15.6:0/113764852 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0b9e60 con 0x7f80bc144bb0 2023-12-19T13:33:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.092+0000 7f80baffd640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc0b77d0 0x7f80bc144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.093+0000 7f80bbfff640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc144bb0 0x7f80bc14afa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06aca0 tx=0x7f80b402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8618ed13882ed2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.093+0000 7f80ba7fc640 1 -- 172.21.15.6:0/113764852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b402c9e0 con 0x7f80bc144bb0 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.093+0000 7f80ba7fc640 1 -- 172.21.15.6:0/113764852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b402cb40 con 0x7f80bc144bb0 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.093+0000 7f80ba7fc640 1 -- 172.21.15.6:0/113764852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40343f0 con 0x7f80bc144bb0 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 -- 172.21.15.6:0/113764852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc144bb0 msgr2=0x7f80bc14afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc144bb0 0x7f80bc14afa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06aca0 tx=0x7f80b402be40 comp rx=0 tx=0).stop 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 -- 172.21.15.6:0/113764852 shutdown_connections 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc144bb0 0x7f80bc14afa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/113764852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc0b77d0 0x7f80bc144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/113764852 >> v2:172.21.15.89:3300/0 conn(0x7f80bc0b8690 0x7f80bc0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 -- 172.21.15.6:0/113764852 >> 172.21.15.6:0/113764852 conn(0x7f80bc06b6a0 msgr2=0x7f80bc06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 -- 172.21.15.6:0/113764852 shutdown_connections 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.094+0000 7f80c1f3c640 1 -- 172.21.15.6:0/113764852 wait complete. 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 Processor -- start 2023-12-19T13:33:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 -- start start 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80bc0b77d0 0x7f80bc13bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 0x7f80bc147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc144bb0 0x7f80bc13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc13c3e0 con 0x7f80bc0b8690 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc148e50 con 0x7f80bc0b77d0 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.095+0000 7f80c1f3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc145650 con 0x7f80bc144bb0 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 0x7f80bc147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 0x7f80bc147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52248/0 (socket says 172.21.15.6:52248) 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 -- 172.21.15.6:0/3923583806 learned_addr learned my addr 172.21.15.6:0/3923583806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80bc0b77d0 0x7f80bc13bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80bbfff640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc144bb0 0x7f80bc13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 -- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc144bb0 msgr2=0x7f80bc13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc144bb0 0x7f80bc13fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 -- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80bc0b77d0 msgr2=0x7f80bc13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80bc0b77d0 0x7f80bc13bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 -- 172.21.15.6:0/3923583806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009b30 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80bbfff640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc144bb0 0x7f80bc13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80baffd640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 0x7f80bc147180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f80b000e810 tx=0x7f80b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0004030 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0004190 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0004520 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc1490f0 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.096+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc1496b0 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.097+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc073a40 con 0x7f80bc0b8690 2023-12-19T13:33:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.098+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80b000c6d0 con 0x7f80bc0b8690 2023-12-19T13:33:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.098+0000 7f80a3fff640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f80a806a430 0x7f80a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.098+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80b0088490 con 0x7f80bc0b8690 2023-12-19T13:33:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.098+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f80a806a430 0x7f80a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.099+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f80a806a430 0x7f80a806c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009b40 tx=0x7f80ac009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.102+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f80b0053aa0 con 0x7f80bc0b8690 2023-12-19T13:33:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.277+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80bc0b8d90 con 0x7f80bc0b8690 2023-12-19T13:33:19.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.277+0000 7f80a3fff640 1 -- 172.21.15.6:0/3923583806 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80b00570c0 con 0x7f80bc0b8690 2023-12-19T13:33:19.279 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:19.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f80a806a430 msgr2=0x7f80a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f80a806a430 0x7f80a806c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009b40 tx=0x7f80ac009190 comp rx=0 tx=0).stop 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 msgr2=0x7f80bc147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 0x7f80bc147180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f80b000e810 tx=0x7f80b000ecd0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 shutdown_connections 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f80a806a430 0x7f80a806c8f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80bc144bb0 0x7f80bc13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc0b8690 0x7f80bc147180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 --2- 172.21.15.6:0/3923583806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80bc0b77d0 0x7f80bc13bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 >> 172.21.15.6:0/3923583806 conn(0x7f80bc06b6a0 msgr2=0x7f80bc06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 shutdown_connections 2023-12-19T13:33:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.279+0000 7f80c1f3c640 1 -- 172.21.15.6:0/3923583806 wait complete. 2023-12-19T13:33:19.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.398+0000 7fee740a1640 1 Processor -- start 2023-12-19T13:33:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.398+0000 7fee740a1640 1 -- start start 2023-12-19T13:33:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee740a1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee6c0b8690 0x7fee6c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee740a1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c14ab10 con 0x7fee6c0b77d0 2023-12-19T13:33:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee740a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c06c2f0 con 0x7fee6c144d80 2023-12-19T13:33:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee740a1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0ba620 con 0x7fee6c0b8690 2023-12-19T13:33:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee71e3d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee6c0b8690 0x7fee6c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee7163c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee6c0b77d0 0x7fee6c144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57220/0 (socket says 172.21.15.6:57220) 2023-12-19T13:33:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee7163c640 1 -- 172.21.15.6:0/1463591824 learned_addr learned my addr 172.21.15.6:0/1463591824 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee71e3d640 1 -- 172.21.15.6:0/1463591824 >> v1:172.21.15.89:6789/0 conn(0x7fee6c144d80 legacy=0x7fee6c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee71e3d640 1 -- 172.21.15.6:0/1463591824 >> v1:172.21.15.6:6789/0 conn(0x7fee6c0b77d0 legacy=0x7fee6c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.399+0000 7fee71e3d640 1 -- 172.21.15.6:0/1463591824 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0b9e60 con 0x7fee6c0b8690 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.400+0000 7fee71e3d640 1 --2- 172.21.15.6:0/1463591824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b8690 0x7fee6c0b8a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee680097a0 tx=0x7fee6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8154767f9b395aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.400+0000 7fee70e3b640 1 -- 172.21.15.6:0/1463591824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6802e070 con 0x7fee6c0b8690 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.400+0000 7fee70e3b640 1 -- 172.21.15.6:0/1463591824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee680315a0 con 0x7fee6c0b8690 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.400+0000 7fee70e3b640 1 -- 172.21.15.6:0/1463591824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68031930 con 0x7fee6c0b8690 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.400+0000 7fee740a1640 1 -- 172.21.15.6:0/1463591824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b8690 msgr2=0x7fee6c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.400+0000 7fee740a1640 1 --2- 172.21.15.6:0/1463591824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b8690 0x7fee6c0b8a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee680097a0 tx=0x7fee6802b840 comp rx=0 tx=0).stop 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.401+0000 7fee740a1640 1 -- 172.21.15.6:0/1463591824 shutdown_connections 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.401+0000 7fee740a1640 1 --2- 172.21.15.6:0/1463591824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b8690 0x7fee6c0b8a70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.401+0000 7fee740a1640 1 -- 172.21.15.6:0/1463591824 >> 172.21.15.6:0/1463591824 conn(0x7fee6c06b6a0 msgr2=0x7fee6c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.401+0000 7fee740a1640 1 -- 172.21.15.6:0/1463591824 shutdown_connections 2023-12-19T13:33:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.401+0000 7fee740a1640 1 -- 172.21.15.6:0/1463591824 wait complete. 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 Processor -- start 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 -- start start 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 0x7fee6c1458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6c0b8690 0x7fee6c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee6c144d80 0x7fee6c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c146de0 con 0x7fee6c0b77d0 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c149d80 con 0x7fee6c144d80 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee740a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c146fc0 con 0x7fee6c0b8690 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee71e3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 0x7fee6c1458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee71e3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 0x7fee6c1458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52266/0 (socket says 172.21.15.6:52266) 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.402+0000 7fee71e3d640 1 -- 172.21.15.6:0/2484771420 learned_addr learned my addr 172.21.15.6:0/2484771420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee7263e640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee6c144d80 0x7fee6c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee7163c640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6c0b8690 0x7fee6c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee71e3d640 1 -- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6c0b8690 msgr2=0x7fee6c1477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee71e3d640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6c0b8690 0x7fee6c1477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee71e3d640 1 -- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee6c144d80 msgr2=0x7fee6c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee71e3d640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee6c144d80 0x7fee6c149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee71e3d640 1 -- 172.21.15.6:0/2484771420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68009400 con 0x7fee6c0b77d0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee7263e640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee6c144d80 0x7fee6c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee71e3d640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 0x7fee6c1458b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee68000c00 tx=0x7fee680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68032840 con 0x7fee6c0b77d0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee680329a0 con 0x7fee6c0b77d0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c1472a0 con 0x7fee6c0b77d0 2023-12-19T13:33:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68032d50 con 0x7fee6c0b77d0 2023-12-19T13:33:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.403+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c141b10 con 0x7fee6c0b77d0 2023-12-19T13:33:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.404+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c073a40 con 0x7fee6c0b77d0 2023-12-19T13:33:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.405+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee6804d3f0 con 0x7fee6c0b77d0 2023-12-19T13:33:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.405+0000 7fee627fc640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fee5006a430 0x7fee5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.405+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee680aa500 con 0x7fee6c0b77d0 2023-12-19T13:33:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.405+0000 7fee7163c640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fee5006a430 0x7fee5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.406+0000 7fee7163c640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fee5006a430 0x7fee5006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee6c1433b0 tx=0x7fee5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.409+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee68075c30 con 0x7fee6c0b77d0 2023-12-19T13:33:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.584+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee6c142e20 con 0x7fee6c0b77d0 2023-12-19T13:33:19.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.585+0000 7fee627fc640 1 -- 172.21.15.6:0/2484771420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee68079250 con 0x7fee6c0b77d0 2023-12-19T13:33:19.587 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fee5006a430 msgr2=0x7fee5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fee5006a430 0x7fee5006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee6c1433b0 tx=0x7fee5c009040 comp rx=0 tx=0).stop 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 msgr2=0x7fee6c1458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 0x7fee6c1458b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee68000c00 tx=0x7fee680046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 shutdown_connections 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fee5006a430 0x7fee5006c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee6c144d80 0x7fee6c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6c0b8690 0x7fee6c1477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 --2- 172.21.15.6:0/2484771420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee6c0b77d0 0x7fee6c1458b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 >> 172.21.15.6:0/2484771420 conn(0x7fee6c06b6a0 msgr2=0x7fee6c0ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 shutdown_connections 2023-12-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.586+0000 7fee740a1640 1 -- 172.21.15.6:0/2484771420 wait complete. 2023-12-19T13:33:19.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:19.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.702+0000 7f5c95d73640 1 Processor -- start 2023-12-19T13:33:19.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.702+0000 7f5c95d73640 1 -- start start 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c95d73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c900ba290 0x7f5c9006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c95d73640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9006b820 con 0x7f5c9006d770 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c95d73640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9006eac0 con 0x7f5c9006f420 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c95d73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9006de60 con 0x7f5c900ba290 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c900ba290 0x7f5c9006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5c9006d770 0x7f5c9014aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57234/0 (socket says 172.21.15.6:57234) 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8effd640 1 -- 172.21.15.6:0/14261913 learned_addr learned my addr 172.21.15.6:0/14261913 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/14261913 >> v1:172.21.15.89:6789/0 conn(0x7f5c9006f420 legacy=0x7f5c90155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/14261913 >> v1:172.21.15.6:6789/0 conn(0x7f5c9006d770 legacy=0x7f5c9014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/14261913 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9006aef0 con 0x7f5c900ba290 2023-12-19T13:33:19.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.703+0000 7f5c8e7fc640 1 -- 172.21.15.6:0/14261913 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481771144 0 0) 0x7f5c9006b820 con 0x7f5c9006d770 2023-12-19T13:33:19.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.704+0000 7f5c8f7fe640 1 --2- 172.21.15.6:0/14261913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9006eee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5c800097a0 tx=0x7f5c8002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d096b1a169b0fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.706+0000 7f5c8e7fc640 1 -- 172.21.15.6:0/14261913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8002f810 con 0x7f5c900ba290 2023-12-19T13:33:19.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.706+0000 7f5c8e7fc640 1 -- 172.21.15.6:0/14261913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8002f970 con 0x7f5c900ba290 2023-12-19T13:33:19.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.706+0000 7f5c8e7fc640 1 -- 172.21.15.6:0/14261913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8002fd00 con 0x7f5c900ba290 2023-12-19T13:33:19.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 -- 172.21.15.6:0/14261913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 msgr2=0x7f5c9006eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 --2- 172.21.15.6:0/14261913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9006eee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5c800097a0 tx=0x7f5c8002b9f0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 -- 172.21.15.6:0/14261913 shutdown_connections 2023-12-19T13:33:19.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 --2- 172.21.15.6:0/14261913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9006eee0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 -- 172.21.15.6:0/14261913 >> 172.21.15.6:0/14261913 conn(0x7f5c900bac30 msgr2=0x7f5c900bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 -- 172.21.15.6:0/14261913 shutdown_connections 2023-12-19T13:33:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.707+0000 7f5c95d73640 1 -- 172.21.15.6:0/14261913 wait complete. 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.708+0000 7f5c95d73640 1 Processor -- start 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.708+0000 7f5c95d73640 1 -- start start 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c95d73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006d770 0x7f5c90148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c95d73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006f420 0x7f5c9014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c95d73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c95d73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c901e0a00 con 0x7f5c900ba290 2023-12-19T13:33:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c95d73640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90149060 con 0x7f5c9006d770 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c95d73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c901e03b0 con 0x7f5c9006f420 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9014a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52284/0 (socket says 172.21.15.6:52284) 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 -- 172.21.15.6:0/3986313528 learned_addr learned my addr 172.21.15.6:0/3986313528 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8effd640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006f420 0x7f5c9014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8f7fe640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006d770 0x7f5c90148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 -- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006f420 msgr2=0x7f5c9014e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006f420 0x7f5c9014e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 -- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006d770 msgr2=0x7f5c90148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006d770 0x7f5c90148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 -- 172.21.15.6:0/3986313528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80009400 con 0x7f5c900ba290 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8effd640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006f420 0x7f5c9014e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.709+0000 7f5c8ffff640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9014a5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c7d0 tx=0x7f5c8800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.710+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88003b70 con 0x7f5c900ba290 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.710+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88003cf0 con 0x7f5c900ba290 2023-12-19T13:33:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.710+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c901e0690 con 0x7f5c900ba290 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.710+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800aa30 con 0x7f5c900ba290 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.710+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9014ea30 con 0x7f5c900ba290 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.711+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c901e0bb0 con 0x7f5c900ba290 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.711+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c8800ab90 con 0x7f5c900ba290 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.711+0000 7f5c77fff640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7c06a460 0x7f5c7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.712+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c88088670 con 0x7f5c900ba290 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.712+0000 7f5c8f7fe640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7c06a460 0x7f5c7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.712+0000 7f5c8f7fe640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7c06a460 0x7f5c7c06c920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c80036000 tx=0x7f5c80008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.716+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c901e0bb0 con 0x7f5c900ba290 2023-12-19T13:33:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.933+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c901e0bb0 con 0x7f5c900ba290 2023-12-19T13:33:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.933+0000 7f5c77fff640 1 -- 172.21.15.6:0/3986313528 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f5c901e0bb0 con 0x7f5c900ba290 2023-12-19T13:33:19.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:19.936 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7c06a460 msgr2=0x7f5c7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7c06a460 0x7f5c7c06c920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c80036000 tx=0x7f5c80008030 comp rx=0 tx=0).stop 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 msgr2=0x7f5c9014a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9014a5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c7d0 tx=0x7f5c8800cc90 comp rx=0 tx=0).stop 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 shutdown_connections 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c7c06a460 0x7f5c7c06c920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c900ba290 0x7f5c9014a5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.935+0000 7f5c95d73640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006f420 0x7f5c9014e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.936+0000 7f5c95d73640 1 --2- 172.21.15.6:0/3986313528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c9006d770 0x7f5c90148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.936+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 >> 172.21.15.6:0/3986313528 conn(0x7f5c900bac30 msgr2=0x7f5c900a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.936+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 shutdown_connections 2023-12-19T13:33:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:19.936+0000 7f5c95d73640 1 -- 172.21.15.6:0/3986313528 wait complete. 2023-12-19T13:33:19.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:20.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.051+0000 7f485f2ad640 1 Processor -- start 2023-12-19T13:33:20.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.051+0000 7f485f2ad640 1 -- start start 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485f2ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48580ba3a0 0x7f485806f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485f2ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485806d7b0 0x7f48580b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485f2ad640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580ba780 con 0x7f485814ca90 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485f2ad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580b5330 con 0x7f485806d7b0 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485f2ad640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485806f900 con 0x7f48580ba3a0 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485d84a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485806d7b0 0x7f48580b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485d84a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485806d7b0 0x7f48580b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52300/0 (socket says 172.21.15.6:52300) 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485d84a640 1 -- 172.21.15.6:0/3230722006 learned_addr learned my addr 172.21.15.6:0/3230722006 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.052+0000 7f485d049640 1 --2- 172.21.15.6:0/3230722006 >> v2:172.21.15.89:3300/0 conn(0x7f48580ba3a0 0x7f485806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f485d84a640 1 -- 172.21.15.6:0/3230722006 >> v2:172.21.15.89:3300/0 conn(0x7f48580ba3a0 msgr2=0x7f485806f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f485d84a640 1 --2- 172.21.15.6:0/3230722006 >> v2:172.21.15.89:3300/0 conn(0x7f48580ba3a0 0x7f485806f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f485d84a640 1 -- 172.21.15.6:0/3230722006 >> v1:172.21.15.89:6789/0 conn(0x7f485814ca90 legacy=0x7f48580b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:20.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f485d84a640 1 -- 172.21.15.6:0/3230722006 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485814c600 con 0x7f485806d7b0 2023-12-19T13:33:20.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f485d049640 1 --2- 172.21.15.6:0/3230722006 >> v2:172.21.15.89:3300/0 conn(0x7f48580ba3a0 0x7f485806f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f485d84a640 1 --2- 172.21.15.6:0/3230722006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f48580b4df0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f48580bb8b0 tx=0x7f485002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bf5217fa516284 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.053+0000 7f484ffff640 1 -- 172.21.15.6:0/3230722006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485002ca80 con 0x7f485806d7b0 2023-12-19T13:33:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f484ffff640 1 -- 172.21.15.6:0/3230722006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485002cbe0 con 0x7f485806d7b0 2023-12-19T13:33:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f484ffff640 1 -- 172.21.15.6:0/3230722006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500343f0 con 0x7f485806d7b0 2023-12-19T13:33:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 -- 172.21.15.6:0/3230722006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 msgr2=0x7f48580b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 --2- 172.21.15.6:0/3230722006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f48580b4df0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f48580bb8b0 tx=0x7f485002bee0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 -- 172.21.15.6:0/3230722006 shutdown_connections 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 --2- 172.21.15.6:0/3230722006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f48580b4df0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 --2- 172.21.15.6:0/3230722006 >> v2:172.21.15.89:3300/0 conn(0x7f48580ba3a0 0x7f485806f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 -- 172.21.15.6:0/3230722006 >> 172.21.15.6:0/3230722006 conn(0x7f48580bac30 msgr2=0x7f48580bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 -- 172.21.15.6:0/3230722006 shutdown_connections 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.054+0000 7f485f2ad640 1 -- 172.21.15.6:0/3230722006 wait complete. 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.055+0000 7f485f2ad640 1 Processor -- start 2023-12-19T13:33:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.055+0000 7f485f2ad640 1 -- start start 2023-12-19T13:33:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485f2ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f4858141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485f2ad640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580ba3a0 0x7f48581de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485f2ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485814ca90 0x7f48580a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485f2ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858141e70 con 0x7f485806d7b0 2023-12-19T13:33:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485f2ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48580a14a0 con 0x7f485814ca90 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485f2ad640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48580a11c0 con 0x7f48580ba3a0 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f4858141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f4858141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52312/0 (socket says 172.21.15.6:52312) 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 -- 172.21.15.6:0/4197376039 learned_addr learned my addr 172.21.15.6:0/4197376039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d84a640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485814ca90 0x7f48580a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485c848640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580ba3a0 0x7f48581de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 -- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580ba3a0 msgr2=0x7f48581de540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580ba3a0 0x7f48581de540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 -- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485814ca90 msgr2=0x7f48580a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485814ca90 0x7f48580a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 -- 172.21.15.6:0/4197376039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009b30 con 0x7f485806d7b0 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.056+0000 7f485d049640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f4858141930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f485400c7f0 tx=0x7f485400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.057+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854007a30 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.057+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854007b90 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.057+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48581ddd40 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.057+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400ce40 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.057+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48581dea80 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.058+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48581de260 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.058+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48540113f0 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.059+0000 7f484dffb640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f483c06a430 0x7f483c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.059+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4854088a30 con 0x7f485806d7b0 2023-12-19T13:33:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.059+0000 7f485c848640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f483c06a430 0x7f483c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.059+0000 7f485c848640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f483c06a430 0x7f483c06c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4858140c10 tx=0x7f4848009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.063+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f48581de260 con 0x7f485806d7b0 2023-12-19T13:33:20.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.241+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48581de260 con 0x7f485806d7b0 2023-12-19T13:33:20.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.242+0000 7f484dffb640 1 -- 172.21.15.6:0/4197376039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f48581de260 con 0x7f485806d7b0 2023-12-19T13:33:20.245 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f483c06a430 msgr2=0x7f483c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f483c06a430 0x7f483c06c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4858140c10 tx=0x7f4848009060 comp rx=0 tx=0).stop 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 msgr2=0x7f4858141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f4858141930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f485400c7f0 tx=0x7f485400cbf0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 shutdown_connections 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f483c06a430 0x7f483c06c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485814ca90 0x7f48580a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580ba3a0 0x7f48581de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 --2- 172.21.15.6:0/4197376039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485806d7b0 0x7f4858141930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.244+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 >> 172.21.15.6:0/4197376039 conn(0x7f48580bac30 msgr2=0x7f48580bc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.245+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 shutdown_connections 2023-12-19T13:33:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.245+0000 7f485f2ad640 1 -- 172.21.15.6:0/4197376039 wait complete. 2023-12-19T13:33:20.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.360+0000 7f842345f640 1 Processor -- start 2023-12-19T13:33:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f842345f640 1 -- start start 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f842345f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f841c070ec0 0x7f841c0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f842345f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f841c151300 0x7f841c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f842345f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c0b8550 con 0x7f841c0712a0 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f842345f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0b7a70 con 0x7f841c070ec0 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f842345f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0b7d50 con 0x7f841c151300 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f84211fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f841c070ec0 0x7f841c0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f84211fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f841c070ec0 0x7f841c0b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52318/0 (socket says 172.21.15.6:52318) 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.361+0000 7f84211fb640 1 -- 172.21.15.6:0/3662249638 learned_addr learned my addr 172.21.15.6:0/3662249638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.362+0000 7f84219fc640 1 --2- 172.21.15.6:0/3662249638 >> v2:172.21.15.89:3300/0 conn(0x7f841c151300 0x7f841c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.362+0000 7f84211fb640 1 -- 172.21.15.6:0/3662249638 >> v2:172.21.15.89:3300/0 conn(0x7f841c151300 msgr2=0x7f841c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.362+0000 7f84211fb640 1 --2- 172.21.15.6:0/3662249638 >> v2:172.21.15.89:3300/0 conn(0x7f841c151300 0x7f841c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.362+0000 7f84211fb640 1 -- 172.21.15.6:0/3662249638 >> v1:172.21.15.89:6789/0 conn(0x7f841c0712a0 legacy=0x7f841c1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.362+0000 7f84211fb640 1 -- 172.21.15.6:0/3662249638 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0b8030 con 0x7f841c070ec0 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.362+0000 7f84211fb640 1 --2- 172.21.15.6:0/3662249638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c0b5a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f841c06fa70 tx=0x7f841402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfe8e4d64678cc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f841bfff640 1 -- 172.21.15.6:0/3662249638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414030840 con 0x7f841c070ec0 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f841bfff640 1 -- 172.21.15.6:0/3662249638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84140309a0 con 0x7f841c070ec0 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f841bfff640 1 -- 172.21.15.6:0/3662249638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414030d30 con 0x7f841c070ec0 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 -- 172.21.15.6:0/3662249638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 msgr2=0x7f841c0b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 --2- 172.21.15.6:0/3662249638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c0b5a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f841c06fa70 tx=0x7f841402b980 comp rx=0 tx=0).stop 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 -- 172.21.15.6:0/3662249638 shutdown_connections 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 --2- 172.21.15.6:0/3662249638 >> v2:172.21.15.89:3300/0 conn(0x7f841c151300 0x7f841c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 --2- 172.21.15.6:0/3662249638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c0b5a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 -- 172.21.15.6:0/3662249638 >> 172.21.15.6:0/3662249638 conn(0x7f841c0be150 msgr2=0x7f841c0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 -- 172.21.15.6:0/3662249638 shutdown_connections 2023-12-19T13:33:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.363+0000 7f842345f640 1 -- 172.21.15.6:0/3662249638 wait complete. 2023-12-19T13:33:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.364+0000 7f842345f640 1 Processor -- start 2023-12-19T13:33:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.364+0000 7f842345f640 1 -- start start 2023-12-19T13:33:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f842345f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f842345f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841c0712a0 0x7f841c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f842345f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f841c151300 0x7f841c146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f842345f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c14b020 con 0x7f841c070ec0 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f842345f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c14a7b0 con 0x7f841c0712a0 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f842345f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c14a270 con 0x7f841c151300 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52330/0 (socket says 172.21.15.6:52330) 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 -- 172.21.15.6:0/2985853849 learned_addr learned my addr 172.21.15.6:0/2985853849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84209fa640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841c0712a0 0x7f841c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84219fc640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f841c151300 0x7f841c146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 -- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f841c151300 msgr2=0x7f841c146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f841c151300 0x7f841c146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 -- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841c0712a0 msgr2=0x7f841c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841c0712a0 0x7f841c146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 -- 172.21.15.6:0/2985853849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140094d0 con 0x7f841c070ec0 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84209fa640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841c0712a0 0x7f841c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.365+0000 7f84211fb640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c149d30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f841402b9c0 tx=0x7f8414004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.366+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414030810 con 0x7f841c070ec0 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.366+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414039d90 con 0x7f841c070ec0 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.366+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414043670 con 0x7f841c070ec0 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.366+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c14c5a0 con 0x7f841c070ec0 2023-12-19T13:33:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.366+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c14b210 con 0x7f841c070ec0 2023-12-19T13:33:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.367+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c073a40 con 0x7f841c070ec0 2023-12-19T13:33:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.367+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f841404c3b0 con 0x7f841c070ec0 2023-12-19T13:33:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.368+0000 7f8419ffb640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f840806a430 0x7f840806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.368+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84140ab190 con 0x7f841c070ec0 2023-12-19T13:33:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.368+0000 7f84209fa640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f840806a430 0x7f840806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.368+0000 7f84209fa640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f840806a430 0x7f840806c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f841c148160 tx=0x7f8410009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.372+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f84140766e0 con 0x7f841c070ec0 2023-12-19T13:33:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.586+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f841c071880 con 0x7f841c070ec0 2023-12-19T13:33:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.587+0000 7f8419ffb640 1 -- 172.21.15.6:0/2985853849 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f8414079d00 con 0x7f841c070ec0 2023-12-19T13:33:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:20.589 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f840806a430 msgr2=0x7f840806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f840806a430 0x7f840806c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f841c148160 tx=0x7f8410009040 comp rx=0 tx=0).stop 2023-12-19T13:33:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 msgr2=0x7f841c149d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c149d30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f841402b9c0 tx=0x7f8414004730 comp rx=0 tx=0).stop 2023-12-19T13:33:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 shutdown_connections 2023-12-19T13:33:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f840806a430 0x7f840806c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f841c151300 0x7f841c146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841c0712a0 0x7f841c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 --2- 172.21.15.6:0/2985853849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841c070ec0 0x7f841c149d30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 >> 172.21.15.6:0/2985853849 conn(0x7f841c0be150 msgr2=0x7f841c0bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 shutdown_connections 2023-12-19T13:33:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:20.589+0000 7f842345f640 1 -- 172.21.15.6:0/2985853849 wait complete. 2023-12-19T13:33:20.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:33:08.029278+0000', 'modified': '2023-12-19T13:33:10.669689+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/112295983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 112295983}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 112295983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:33:20.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:33:20.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T13:33:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.011+0000 7f24858c0640 1 Processor -- start 2023-12-19T13:33:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.011+0000 7f24858c0640 1 -- start start 2023-12-19T13:33:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24858c0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f24800bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24858c0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f248014aa00 0x7f24800b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24858c0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2480140ef0 0x7f2480141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24858c0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24800bbca0 con 0x7f2480140ef0 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24858c0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24801418c0 con 0x7f248014aa00 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24858c0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800bacc0 con 0x7f24800b79f0 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2480140ef0 0x7f2480141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2480140ef0 0x7f2480141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52334/0 (socket says 172.21.15.6:52334) 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 -- 172.21.15.6:0/2955545085 learned_addr learned my addr 172.21.15.6:0/2955545085 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247effd640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f24800bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24767fc640 1 --2- 172.21.15.6:0/2955545085 >> v2:172.21.15.89:3300/0 conn(0x7f248014aa00 0x7f24800b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 -- 172.21.15.6:0/2955545085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 msgr2=0x7f24800bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f24800bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 -- 172.21.15.6:0/2955545085 >> v2:172.21.15.89:3300/0 conn(0x7f248014aa00 msgr2=0x7f24800b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 --2- 172.21.15.6:0/2955545085 >> v2:172.21.15.89:3300/0 conn(0x7f248014aa00 0x7f24800b83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247f7fe640 1 -- 172.21.15.6:0/2955545085 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800bbe60 con 0x7f2480140ef0 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f247effd640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f24800bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.012+0000 7f24767fc640 1 --2- 172.21.15.6:0/2955545085 >> v2:172.21.15.89:3300/0 conn(0x7f248014aa00 0x7f24800b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f247f7fe640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2480140ef0 0x7f2480141380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2480066720 tx=0x7f247802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a9f36124adb52f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f247e7fc640 1 -- 172.21.15.6:0/2955545085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247802cb00 con 0x7f2480140ef0 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f247e7fc640 1 -- 172.21.15.6:0/2955545085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247802cc60 con 0x7f2480140ef0 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f247e7fc640 1 -- 172.21.15.6:0/2955545085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24780343f0 con 0x7f2480140ef0 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f24858c0640 1 -- 172.21.15.6:0/2955545085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2480140ef0 msgr2=0x7f2480141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f24858c0640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2480140ef0 0x7f2480141380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2480066720 tx=0x7f247802bf60 comp rx=0 tx=0).stop 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f24858c0640 1 -- 172.21.15.6:0/2955545085 shutdown_connections 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.013+0000 7f24858c0640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2480140ef0 0x7f2480141380 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.014+0000 7f24858c0640 1 --2- 172.21.15.6:0/2955545085 >> v2:172.21.15.89:3300/0 conn(0x7f248014aa00 0x7f24800b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.014+0000 7f24858c0640 1 --2- 172.21.15.6:0/2955545085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f24800bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.014+0000 7f24858c0640 1 -- 172.21.15.6:0/2955545085 >> 172.21.15.6:0/2955545085 conn(0x7f24800c0340 msgr2=0x7f24800c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.014+0000 7f24858c0640 1 -- 172.21.15.6:0/2955545085 shutdown_connections 2023-12-19T13:33:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.014+0000 7f24858c0640 1 -- 172.21.15.6:0/2955545085 wait complete. 2023-12-19T13:33:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 Processor -- start 2023-12-19T13:33:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 -- start start 2023-12-19T13:33:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f2480147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2480140ef0 0x7f2480146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 0x7f24800bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480146da0 con 0x7f248014aa00 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800bf170 con 0x7f2480140ef0 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f24858c0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800bfb40 con 0x7f24800b79f0 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f247f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 0x7f24800bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f247f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 0x7f24800bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52348/0 (socket says 172.21.15.6:52348) 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.015+0000 7f247f7fe640 1 -- 172.21.15.6:0/3607214053 learned_addr learned my addr 172.21.15.6:0/3607214053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f24767fc640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2480140ef0 0x7f2480146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247effd640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f2480147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247f7fe640 1 -- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 msgr2=0x7f2480147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247f7fe640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f2480147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247f7fe640 1 -- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2480140ef0 msgr2=0x7f2480146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247f7fe640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2480140ef0 0x7f2480146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247f7fe640 1 -- 172.21.15.6:0/3607214053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478009b30 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247f7fe640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 0x7f24800bf600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2478009f40 tx=0x7f2478004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247cff9640 1 -- 172.21.15.6:0/3607214053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478009510 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247cff9640 1 -- 172.21.15.6:0/3607214053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247803e450 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f247cff9640 1 -- 172.21.15.6:0/3607214053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247803e800 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248013bec0 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.016+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248013ab90 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.018+0000 7f247cff9640 1 -- 172.21.15.6:0/3607214053 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f247803e960 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.018+0000 7f247cff9640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f246006a460 0x7f246006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.018+0000 7f247cff9640 1 -- 172.21.15.6:0/3607214053 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24780ab710 con 0x7f248014aa00 2023-12-19T13:33:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.018+0000 7f247effd640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f246006a460 0x7f246006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.019+0000 7f248842a740 1 Processor -- start 2023-12-19T13:33:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.019+0000 7f247effd640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f246006a460 0x7f246006c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2470006b10 tx=0x7f2470008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.019+0000 7f248842a740 1 -- start start 2023-12-19T13:33:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f248842a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 0x55f4da2d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2d2af0 0x55f4da3037c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da303d00 0x55f4da304180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f248842a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da242030 con 0x55f4da30e420 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da23f7c0 con 0x55f4da303d00 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4da23b0b0 con 0x55f4da2d2af0 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 0x55f4da2d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 0x55f4da2d25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52354/0 (socket says 172.21.15.6:52354) 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 -- 172.21.15.6:0/4257548595 learned_addr learned my addr 172.21.15.6:0/4257548595 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247f7fe640 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da303d00 0x55f4da304180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f24767fc640 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2d2af0 0x55f4da3037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 -- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2d2af0 msgr2=0x55f4da3037c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2d2af0 0x55f4da3037c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 -- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da303d00 msgr2=0x55f4da304180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da303d00 0x55f4da304180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 -- 172.21.15.6:0/4257548595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4da1f5bc0 con 0x55f4da30e420 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.020+0000 7f247effd640 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 0x55f4da2d25b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f247000eb90 tx=0x7f2470011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d029827369d97ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f24757fa640 1 -- 172.21.15.6:0/4257548595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470013d60 con 0x55f4da30e420 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f24757fa640 1 -- 172.21.15.6:0/4257548595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470018070 con 0x55f4da30e420 2023-12-19T13:33:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f24757fa640 1 -- 172.21.15.6:0/4257548595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247001f640 con 0x55f4da30e420 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 -- 172.21.15.6:0/4257548595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 msgr2=0x55f4da2d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 0x55f4da2d25b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f247000eb90 tx=0x7f2470011000 comp rx=0 tx=0).stop 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 -- 172.21.15.6:0/4257548595 shutdown_connections 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da303d00 0x55f4da304180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2d2af0 0x55f4da3037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 --2- 172.21.15.6:0/4257548595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da30e420 0x55f4da2d25b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 -- 172.21.15.6:0/4257548595 >> 172.21.15.6:0/4257548595 conn(0x55f4da2d3f80 msgr2=0x55f4da30db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 -- 172.21.15.6:0/4257548595 shutdown_connections 2023-12-19T13:33:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.021+0000 7f248842a740 1 -- 172.21.15.6:0/4257548595 wait complete. 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 -- start start 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 Processor -- start 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da2fac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2fe310 0x55f4da31d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da1f97c0 con 0x55f4da303d00 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da1f9460 con 0x55f4da30e420 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4da1bf1b0 con 0x55f4da2fe310 2023-12-19T13:33:21.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.022+0000 7f248842a740 10 client.0 _ll_register_callbacks cb 0x55f4da1c26d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52364/0 (socket says 172.21.15.6:52364) 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 -- 172.21.15.6:0/1854491168 learned_addr learned my addr 172.21.15.6:0/1854491168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f24767fc640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da2fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247f7fe640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2fe310 0x55f4da31d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 -- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2fe310 msgr2=0x55f4da31d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2fe310 0x55f4da31d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 -- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 msgr2=0x55f4da2fac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da2fac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 -- 172.21.15.6:0/1854491168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247000e870 con 0x55f4da303d00 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f247effd640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fa750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24700138e0 tx=0x7f2470004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad301acb2da05e84 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f245e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f245e7fc640 1 -- 172.21.15.6:0/1854491168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247001fd70 con 0x55f4da303d00 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4da22c9e0 con 0x55f4da303d00 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f245e7fc640 1 -- 172.21.15.6:0/1854491168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2470005990 con 0x55f4da303d00 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f245e7fc640 1 -- 172.21.15.6:0/1854491168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2470005b50 con 0x55f4da303d00 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f248842a740 10 client.4629 fetch_fsmap learned FSMap version 7 2023-12-19T13:33:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f4da239730 con 0x55f4da303d00 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.023+0000 7f245e7fc640 1 -- 172.21.15.6:0/1854491168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f4da22c9e0 con 0x55f4da303d00 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f245e7fc640 1 -- 172.21.15.6:0/1854491168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f2470011070 con 0x55f4da303d00 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f248842a740 10 client.4629 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f248842a740 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f248842a740 20 client.4629 populate_metadata read hostname 'smithi006' 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f248842a740 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da31e090 0x55f4da328ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f248842a740 4 client.4629 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 --> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4da234130 con 0x55f4da31e090 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f24767fc640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da31e090 0x55f4da328ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f24767fc640 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da31e090 0x55f4da328ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4344840382bd57 server_cookie=cbc7bb729cab281d in_seq=0 out_seq=0 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.024+0000 7f245e7fc640 10 client.4629 ms_handle_connect on v2:172.21.15.89:6834/112295983 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f245e7fc640 1 -- 172.21.15.6:0/1854491168 <== mds.0 v2:172.21.15.89:6834/112295983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f4da234130 con 0x55f4da31e090 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f245e7fc640 10 client.4629 handle_command_reply: tid=0 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 client.4629 shutdown 2023-12-19T13:33:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 msgr2=0x55f4da2fa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fa750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24700138e0 tx=0x7f2470004730 comp rx=0 tx=0).stop 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 shutdown_connections 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da31e090 0x55f4da328ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da2fe310 0x55f4da31d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da2fac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f245e7fc640 0 client.4629 ms_handle_reset on v2:172.21.15.89:6834/112295983 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 --2- 172.21.15.6:0/1854491168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fa750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 >> 172.21.15.6:0/1854491168 conn(0x55f4da2d2af0 msgr2=0x55f4da30d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 shutdown_connections 2023-12-19T13:33:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 1 -- 172.21.15.6:0/1854491168 wait complete. 2023-12-19T13:33:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.025+0000 7f248842a740 20 client.4629 trim_cache size 0 max 16384 2023-12-19T13:33:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 Processor -- start 2023-12-19T13:33:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 -- start start 2023-12-19T13:33:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da2fe310 0x55f4da2d6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da30e420 0x55f4da2fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da2ff6d0 con 0x55f4da303d00 2023-12-19T13:33:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da30dd30 con 0x55f4da2fe310 2023-12-19T13:33:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.041+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4da31a3d0 con 0x55f4da30e420 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52374/0 (socket says 172.21.15.6:52374) 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 -- 172.21.15.6:0/2657870781 learned_addr learned my addr 172.21.15.6:0/2657870781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 -- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da30e420 msgr2=0x55f4da2fbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da30e420 0x55f4da2fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 -- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da2fe310 msgr2=0x55f4da2d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f247effd640 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da2fe310 0x55f4da2d6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da2fe310 0x55f4da2d6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 -- 172.21.15.6:0/2657870781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4da1dbb60 con 0x55f4da303d00 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f24767fc640 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fb8d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2468004650 tx=0x7f2468008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cf31196005aad9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f2475ffb640 1 -- 172.21.15.6:0/2657870781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246801b070 con 0x55f4da303d00 2023-12-19T13:33:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f2475ffb640 1 -- 172.21.15.6:0/2657870781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468003e40 con 0x55f4da303d00 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.042+0000 7f2475ffb640 1 -- 172.21.15.6:0/2657870781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246801b3f0 con 0x55f4da303d00 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 -- 172.21.15.6:0/2657870781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 msgr2=0x55f4da2fb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fb8d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2468004650 tx=0x7f2468008040 comp rx=0 tx=0).stop 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 -- 172.21.15.6:0/2657870781 shutdown_connections 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da30e420 0x55f4da2fbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da303d00 0x55f4da2fb8d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 --2- 172.21.15.6:0/2657870781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da2fe310 0x55f4da2d6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 -- 172.21.15.6:0/2657870781 >> 172.21.15.6:0/2657870781 conn(0x55f4da2d2af0 msgr2=0x55f4da2cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 -- 172.21.15.6:0/2657870781 shutdown_connections 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 -- 172.21.15.6:0/2657870781 wait complete. 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 -- start start 2023-12-19T13:33:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.043+0000 7f248842a740 1 Processor -- start 2023-12-19T13:33:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 0x55f4da371d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da303d00 0x55f4da36b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da36bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da30ce80 con 0x55f4da2fe310 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4da2d1f30 con 0x55f4da30e420 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4da372730 con 0x55f4da303d00 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f248842a740 10 client.0 _ll_register_callbacks cb 0x7f247000a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 0x55f4da371d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 0x55f4da371d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52378/0 (socket says 172.21.15.6:52378) 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 -- 172.21.15.6:0/1161858122 learned_addr learned my addr 172.21.15.6:0/1161858122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f24767fc640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da303d00 0x55f4da36b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247f7fe640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da36bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 -- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da303d00 msgr2=0x55f4da36b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da303d00 0x55f4da36b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 -- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 msgr2=0x55f4da36bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da36bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 -- 172.21.15.6:0/1161858122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2468004340 con 0x55f4da2fe310 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247f7fe640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da36bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f24767fc640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da303d00 0x55f4da36b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f247effd640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 0x55f4da371d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f247001fa60 tx=0x7f2470014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2f03d832905eba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.044+0000 7f245e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f245e7fc640 1 -- 172.21.15.6:0/1161858122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470032880 con 0x55f4da2fe310 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f245e7fc640 1 -- 172.21.15.6:0/1161858122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24700329e0 con 0x55f4da2fe310 2023-12-19T13:33:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2470018070 con 0x55f4da2fe310 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f245e7fc640 1 -- 172.21.15.6:0/1161858122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2470013910 con 0x55f4da2fe310 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 10 client.4635 fetch_fsmap learned FSMap version 7 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f4da201270 con 0x55f4da2fe310 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f245e7fc640 1 -- 172.21.15.6:0/1161858122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470018070 con 0x55f4da2fe310 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f245e7fc640 1 -- 172.21.15.6:0/1161858122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f2470011070 con 0x55f4da2fe310 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 10 client.4635 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 10 client.4635 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 20 client.4635 populate_metadata read hostname 'smithi006' 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da2d15e0 0x55f4da3751e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 4 client.4635 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 --> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4da233e50 con 0x55f4da2d15e0 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.045+0000 7f24767fc640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da2d15e0 0x55f4da3751e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f245e7fc640 10 client.4635 ms_handle_connect on v2:172.21.15.89:6834/112295983 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f24767fc640 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da2d15e0 0x55f4da3751e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34a3bf570270ca0 server_cookie=9aa8e99d24618a37 in_seq=0 out_seq=0 2023-12-19T13:33:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f245e7fc640 1 -- 172.21.15.6:0/1161858122 <== mds.0 v2:172.21.15.89:6834/112295983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f4da233e50 con 0x55f4da2d15e0 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f245e7fc640 10 client.4635 handle_command_reply: tid=0 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 client.4635 shutdown 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 msgr2=0x55f4da371d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 0x55f4da371d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f247001fa60 tx=0x7f2470014000 comp rx=0 tx=0).stop 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 shutdown_connections 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:6834/112295983,v1:172.21.15.89:6835/112295983] conn(0x55f4da2d15e0 0x55f4da3751e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4da30e420 0x55f4da36bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55f4da303d00 0x55f4da36b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 --2- 172.21.15.6:0/1161858122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f4da2fe310 0x55f4da371d60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f245e7fc640 0 client.4635 ms_handle_reset on v2:172.21.15.89:6834/112295983 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 >> 172.21.15.6:0/1161858122 conn(0x55f4da2d2af0 msgr2=0x55f4da2d6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 shutdown_connections 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 1 -- 172.21.15.6:0/1161858122 wait complete. 2023-12-19T13:33:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.046+0000 7f248842a740 20 client.4635 trim_cache size 0 max 16384 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "dcbd1077-757f-4b91-a6c2-c01c60d71a4f", 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4291, 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 13.016049005999999, 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 7, 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 20, 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 20, 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 19.436195366 2023-12-19T13:33:21.056 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T13:33:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f246006a460 msgr2=0x7f246006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f246006a460 0x7f246006c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2470006b10 tx=0x7f2470008040 comp rx=0 tx=0).stop 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 msgr2=0x7f24800bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 0x7f24800bf600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2478009f40 tx=0x7f2478004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 shutdown_connections 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f246006a460 0x7f246006c920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248014aa00 0x7f24800bf600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2480140ef0 0x7f2480146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 --2- 172.21.15.6:0/3607214053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24800b79f0 0x7f2480147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 >> 172.21.15.6:0/3607214053 conn(0x7f24800c0340 msgr2=0x7f248013f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 shutdown_connections 2023-12-19T13:33:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.047+0000 7f24858c0640 1 -- 172.21.15.6:0/3607214053 wait complete. 2023-12-19T13:33:21.059 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T13:33:21.088 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T13:33:21.088 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-19T13:33:21.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:21.088 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-12-19T13:33:21.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:21.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-12-19T13:33:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-12-19T13:33:21.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T13:33:21.256 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-19T13:33:21.256 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T13:33:21.256 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:21.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:33:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.360+0000 7fdfb660e640 1 Processor -- start 2023-12-19T13:33:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.360+0000 7fdfb660e640 1 -- start start 2023-12-19T13:33:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfb660e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfb00ba550 0x7fdfb00b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfb660e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb00ba000 0x7fdfb01554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfb660e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00bb310 con 0x7fdfb006a6d0 2023-12-19T13:33:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfb660e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00bf960 con 0x7fdfb00ba550 2023-12-19T13:33:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfb660e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00bb5b0 con 0x7fdfb00ba000 2023-12-19T13:33:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfb00ba550 0x7fdfb00b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdfb006a6d0 0x7fdfb014acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57242/0 (socket says 172.21.15.6:57242) 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaffff640 1 -- 172.21.15.6:0/1127777410 learned_addr learned my addr 172.21.15.6:0/1127777410 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfb4bab640 1 --2- 172.21.15.6:0/1127777410 >> v2:172.21.15.89:3300/0 conn(0x7fdfb00ba000 0x7fdfb01554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/1127777410 >> v2:172.21.15.89:3300/0 conn(0x7fdfb00ba000 msgr2=0x7fdfb01554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/1127777410 >> v2:172.21.15.89:3300/0 conn(0x7fdfb00ba000 0x7fdfb01554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/1127777410 >> v1:172.21.15.6:6789/0 conn(0x7fdfb006a6d0 legacy=0x7fdfb014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaeffd640 1 -- 172.21.15.6:0/1127777410 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764729120 0 0) 0x7fdfb00bb310 con 0x7fdfb006a6d0 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.361+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/1127777410 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00c0120 con 0x7fdfb00ba550 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.362+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/1127777410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb00ba550 0x7fdfb00b9ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdfb009fcb0 tx=0x7fdf9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753a9a68dff61dd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.362+0000 7fdfaeffd640 1 -- 172.21.15.6:0/1127777410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98031830 con 0x7fdfb00ba550 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.362+0000 7fdfaeffd640 1 -- 172.21.15.6:0/1127777410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98031990 con 0x7fdfb00ba550 2023-12-19T13:33:21.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.362+0000 7fdfaeffd640 1 -- 172.21.15.6:0/1127777410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98031d20 con 0x7fdfb00ba550 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 -- 172.21.15.6:0/1127777410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb00ba550 msgr2=0x7fdfb00b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 --2- 172.21.15.6:0/1127777410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb00ba550 0x7fdfb00b9ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdfb009fcb0 tx=0x7fdf9802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 -- 172.21.15.6:0/1127777410 shutdown_connections 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 --2- 172.21.15.6:0/1127777410 >> v2:172.21.15.89:3300/0 conn(0x7fdfb00ba000 0x7fdfb01554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 --2- 172.21.15.6:0/1127777410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb00ba550 0x7fdfb00b9ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 -- 172.21.15.6:0/1127777410 >> 172.21.15.6:0/1127777410 conn(0x7fdfb00c0350 msgr2=0x7fdfb00c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 -- 172.21.15.6:0/1127777410 shutdown_connections 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.363+0000 7fdfb660e640 1 -- 172.21.15.6:0/1127777410 wait complete. 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.364+0000 7fdfb660e640 1 Processor -- start 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.364+0000 7fdfb660e640 1 -- start start 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 0x7fdfb01e3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb00ba000 0x7fdfb014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb00ba550 0x7fdfb014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00b4a70 con 0x7fdfb006a6d0 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb014e3b0 con 0x7fdfb00ba000 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb014e690 con 0x7fdfb00ba550 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 0x7fdfb01e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 0x7fdfb01e3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52402/0 (socket says 172.21.15.6:52402) 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 -- 172.21.15.6:0/2105638052 learned_addr learned my addr 172.21.15.6:0/2105638052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb00ba000 0x7fdfb014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb4bab640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb00ba550 0x7fdfb014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 -- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb00ba550 msgr2=0x7fdfb014ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb00ba550 0x7fdfb014ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 -- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb00ba000 msgr2=0x7fdfb014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb00ba000 0x7fdfb014c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 -- 172.21.15.6:0/2105638052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009400 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb4bab640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb00ba550 0x7fdfb014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb00ba000 0x7fdfb014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfaffff640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 0x7fdfb01e3660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c4d0 tx=0x7fdfa000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00074e0 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0007660 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb01e3f30 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.365+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0004a20 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.366+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb01e3ba0 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.366+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb01e4170 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.367+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdfa0004b80 con 0x7fdfb006a6d0 2023-12-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.367+0000 7fdfacff9640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdf9006a430 0x7fdf9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.367+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfa0087eb0 con 0x7fdfb006a6d0 2023-12-19T13:33:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.368+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdf9006a430 0x7fdf9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.368+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdf9006a430 0x7fdf9006c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf98036000 tx=0x7fdf98008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.372+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdfb01e4170 con 0x7fdfb006a6d0 2023-12-19T13:33:21.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.584+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfb0073a40 con 0x7fdfb006a6d0 2023-12-19T13:33:21.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.585+0000 7fdfacff9640 1 -- 172.21.15.6:0/2105638052 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdfa0018070 con 0x7fdfb006a6d0 2023-12-19T13:33:21.587 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdf9006a430 msgr2=0x7fdf9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdf9006a430 0x7fdf9006c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf98036000 tx=0x7fdf98008030 comp rx=0 tx=0).stop 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 msgr2=0x7fdfb01e3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 0x7fdfb01e3660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c4d0 tx=0x7fdfa000c990 comp rx=0 tx=0).stop 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 shutdown_connections 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdf9006a430 0x7fdf9006c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfb00ba550 0x7fdfb014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb00ba000 0x7fdfb014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 --2- 172.21.15.6:0/2105638052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb006a6d0 0x7fdfb01e3660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:21.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.586+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 >> 172.21.15.6:0/2105638052 conn(0x7fdfb00c0350 msgr2=0x7fdfb014a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:21.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.587+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 shutdown_connections 2023-12-19T13:33:21.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:21.587+0000 7fdfb660e640 1 -- 172.21.15.6:0/2105638052 wait complete. 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:33:21.599 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:33:21.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:21.600 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:33:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-12-19T13:33:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:21.663 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T13:33:21.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:21.663 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-12-19T13:33:21.663 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-12-19T13:33:21.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2023-12-19T13:33:21.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2023-12-19T13:33:21.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2023-12-19T13:33:21.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T13:33:21.664 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-12-19T13:33:22.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:22.137 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:33:22.214 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-12-19T13:33:22.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:22.218 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-12-19T13:33:22.271 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-12-19T13:33:22.271 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:33:22.271 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:33:22.271 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:33:22.271 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:33:22.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:22.272 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-12-19T13:33:22.272 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-12-19T13:33:22.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:33:22.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:33:22.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:33:22.272 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-12-19T13:33:22.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:22.979 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-12-19T13:33:23.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:23.030 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-12-19T13:33:23.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:23.077 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-12-19T13:33:23.077 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-12-19T13:33:23.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:33:23.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T13:33:23.077 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-12-19T13:33:23.250 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T13:33:23.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:23.250 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T13:33:23.251 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-12-19T13:33:23.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:23.534 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-12-19T13:33:23.534 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-12-19T13:33:23.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-12-19T13:33:23.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T13:33:23.534 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-12-19T13:33:23.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:33:23.695 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:23.742 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:33:23.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:33:23.742 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:23.836 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T13:33:23.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:23.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:23.994 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:23.994 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T13:33:23.994 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-12-19T13:33:24.443 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:24.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T13:33:24.444 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-12-19T13:33:24.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-19T13:33:24.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=dcbd1077-757f-4b91-a6c2-c01c60d71a4f" will pass to kernel 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:33:24.474 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:33:24.475 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:33:24.475 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:33:24.475 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:33:24.477 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:33:24.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:24.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:24.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:24.566 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:33:24.633 INFO:teuthology.orchestra.run.smithi144.stdout:client4478 2023-12-19T13:33:24.633 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:33:24.633 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:33:24.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:24.686 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:33:24.749 INFO:teuthology.orchestra.run.smithi144.stdout:client4478 2023-12-19T13:33:24.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:24.750 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:33:24.814 INFO:teuthology.orchestra.run.smithi144.stdout:client4478 2023-12-19T13:33:24.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:24.814 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dcbd1077-757f-4b91-a6c2-c01c60d71a4f.client4478/status') 2023-12-19T13:33:24.913 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4478 (3)172.21.15.144:0/1960671737 2023-12-19T13:33:24.913 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2023-12-19T13:33:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2023-12-19T13:33:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2023-12-19T13:33:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:71 bytes copied, 9.3019e-05 s, 763 kB/s 2023-12-19T13:33:24.917 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T13:33:24.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78c211b640 1 Processor -- start 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78c211b640 1 -- start start 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78c211b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc06a6d0 0x7f78bc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78c211b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0bb310 con 0x7f78bc0ba550 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78c211b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0bf960 con 0x7f78bc14b1f0 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78c211b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0bb5b0 con 0x7f78bc06a6d0 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78bbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78bc0ba550 0x7f78bc1554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57246/0 (socket says 172.21.15.6:57246) 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.050+0000 7f78bbfff640 1 -- 172.21.15.6:0/1925358216 learned_addr learned my addr 172.21.15.6:0/1925358216 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/1925358216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc06a6d0 0x7f78bc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870061088 0 0) 0x7f78bc0bb310 con 0x7f78bc0ba550 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a4003520 con 0x7f78bc0ba550 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121755506 0 0) 0x7f78bc0bf960 con 0x7f78bc14b1f0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc0bb310 con 0x7f78bc14b1f0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78bb7fe640 1 -- 172.21.15.6:0/1925358216 >> v1:172.21.15.89:6789/0 conn(0x7f78bc14b1f0 legacy=0x7f78bc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78bb7fe640 1 -- 172.21.15.6:0/1925358216 >> v1:172.21.15.6:6789/0 conn(0x7f78bc0ba550 legacy=0x7f78bc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.051+0000 7f78bb7fe640 1 -- 172.21.15.6:0/1925358216 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0c0120 con 0x7f78bc06a6d0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.052+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/1925358216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc06a6d0 0x7f78bc14acb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0097d0 tx=0x7f78ac02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f789fdbb2ace010 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.052+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac031890 con 0x7f78bc06a6d0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.052+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0319f0 con 0x7f78bc06a6d0 2023-12-19T13:33:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.052+0000 7f78ba7fc640 1 -- 172.21.15.6:0/1925358216 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac031d60 con 0x7f78bc06a6d0 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 -- 172.21.15.6:0/1925358216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc06a6d0 msgr2=0x7f78bc14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 --2- 172.21.15.6:0/1925358216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc06a6d0 0x7f78bc14acb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0097d0 tx=0x7f78ac02b930 comp rx=0 tx=0).stop 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 -- 172.21.15.6:0/1925358216 shutdown_connections 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 --2- 172.21.15.6:0/1925358216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc06a6d0 0x7f78bc14acb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 -- 172.21.15.6:0/1925358216 >> 172.21.15.6:0/1925358216 conn(0x7f78bc0c0350 msgr2=0x7f78bc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 -- 172.21.15.6:0/1925358216 shutdown_connections 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.053+0000 7f78c211b640 1 -- 172.21.15.6:0/1925358216 wait complete. 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.054+0000 7f78c211b640 1 Processor -- start 2023-12-19T13:33:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.054+0000 7f78c211b640 1 -- start start 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78c211b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 0x7f78bc14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78c211b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78bc0ba550 0x7f78bc1d5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78c211b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc14b1f0 0x7f78bc0b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78c211b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1d7e10 con 0x7f78bc06a6d0 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78c211b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc14ec10 con 0x7f78bc0ba550 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78c211b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1d4bb0 con 0x7f78bc14b1f0 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 0x7f78bc14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 0x7f78bc14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52418/0 (socket says 172.21.15.6:52418) 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 -- 172.21.15.6:0/943755110 learned_addr learned my addr 172.21.15.6:0/943755110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78baffd640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78bc0ba550 0x7f78bc1d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bbfff640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc14b1f0 0x7f78bc0b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 -- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc14b1f0 msgr2=0x7f78bc0b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc14b1f0 0x7f78bc0b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 -- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78bc0ba550 msgr2=0x7f78bc1d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78bc0ba550 0x7f78bc1d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 -- 172.21.15.6:0/943755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009400 con 0x7f78bc06a6d0 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 0x7f78bc14e6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78ac000c00 tx=0x7f78ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac03bbf0 con 0x7f78bc06a6d0 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.055+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac03bd70 con 0x7f78bc06a6d0 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.056+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc1d5c20 con 0x7f78bc06a6d0 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.056+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac045630 con 0x7f78bc06a6d0 2023-12-19T13:33:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.056+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc0b4020 con 0x7f78bc06a6d0 2023-12-19T13:33:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.057+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc1d4700 con 0x7f78bc06a6d0 2023-12-19T13:33:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.057+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f78ac04e450 con 0x7f78bc06a6d0 2023-12-19T13:33:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.057+0000 7f78a3fff640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f78a806a430 0x7f78a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.057+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78ac0aacf0 con 0x7f78bc06a6d0 2023-12-19T13:33:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.058+0000 7f78baffd640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f78a806a430 0x7f78a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.058+0000 7f78baffd640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f78a806a430 0x7f78a806c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78bc14a9b0 tx=0x7f78b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.062+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f78ac0af070 con 0x7f78bc06a6d0 2023-12-19T13:33:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.237+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78bc0a5850 con 0x7f78bc06a6d0 2023-12-19T13:33:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.238+0000 7f78a3fff640 1 -- 172.21.15.6:0/943755110 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f78ac035020 con 0x7f78bc06a6d0 2023-12-19T13:33:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:25.240 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f78a806a430 msgr2=0x7f78a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f78a806a430 0x7f78a806c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78bc14a9b0 tx=0x7f78b0009040 comp rx=0 tx=0).stop 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 msgr2=0x7f78bc14e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 0x7f78bc14e6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78ac000c00 tx=0x7f78ac0046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 shutdown_connections 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f78a806a430 0x7f78a806c8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78bc14b1f0 0x7f78bc0b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78bc0ba550 0x7f78bc1d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 --2- 172.21.15.6:0/943755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc06a6d0 0x7f78bc14e6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 >> 172.21.15.6:0/943755110 conn(0x7f78bc0c0350 msgr2=0x7f78bc0a16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 shutdown_connections 2023-12-19T13:33:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.240+0000 7f78c211b640 1 -- 172.21.15.6:0/943755110 wait complete. 2023-12-19T13:33:25.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:25.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.360+0000 7fa96f23e640 1 Processor -- start 2023-12-19T13:33:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.360+0000 7fa96f23e640 1 -- start start 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96f23e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa9680b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96f23e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa968148ad0 0x7fa96806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96f23e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96806ccb0 con 0x7fa9680b8470 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96f23e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa968070bf0 con 0x7fa968148ad0 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96f23e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680b6450 con 0x7fa9680b8090 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96d7db640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa9680b8470 0x7fa96806c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57256/0 (socket says 172.21.15.6:57256) 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96d7db640 1 -- 172.21.15.6:0/585560130 learned_addr learned my addr 172.21.15.6:0/585560130 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96cfda640 1 --2- 172.21.15.6:0/585560130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa9680b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa967fff640 1 --2- 172.21.15.6:0/585560130 >> v2:172.21.15.89:3300/0 conn(0x7fa968148ad0 0x7fa96806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa9677fe640 1 -- 172.21.15.6:0/585560130 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024320954 0 0) 0x7fa96806ccb0 con 0x7fa9680b8470 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa9677fe640 1 -- 172.21.15.6:0/585560130 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa950003520 con 0x7fa9680b8470 2023-12-19T13:33:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa9677fe640 1 -- 172.21.15.6:0/585560130 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2296414426 0 0) 0x7fa950003520 con 0x7fa9680b8470 2023-12-19T13:33:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96cfda640 1 -- 172.21.15.6:0/585560130 >> v2:172.21.15.89:3300/0 conn(0x7fa968148ad0 msgr2=0x7fa96806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96cfda640 1 --2- 172.21.15.6:0/585560130 >> v2:172.21.15.89:3300/0 conn(0x7fa968148ad0 0x7fa96806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96cfda640 1 -- 172.21.15.6:0/585560130 >> v1:172.21.15.6:6789/0 conn(0x7fa9680b8470 legacy=0x7fa96806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.361+0000 7fa96cfda640 1 -- 172.21.15.6:0/585560130 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968071440 con 0x7fa9680b8090 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.362+0000 7fa96cfda640 1 --2- 172.21.15.6:0/585560130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa9680b5e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9580097a0 tx=0x7fa95802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c8a6904d3c0abd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.362+0000 7fa9677fe640 1 -- 172.21.15.6:0/585560130 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600019f0 con 0x7fa9680b8090 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.362+0000 7fa9677fe640 1 -- 172.21.15.6:0/585560130 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95802e050 con 0x7fa9680b8090 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.362+0000 7fa9677fe640 1 -- 172.21.15.6:0/585560130 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958030710 con 0x7fa9680b8090 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 -- 172.21.15.6:0/585560130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 msgr2=0x7fa9680b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 --2- 172.21.15.6:0/585560130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa9680b5e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9580097a0 tx=0x7fa95802b790 comp rx=0 tx=0).stop 2023-12-19T13:33:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 -- 172.21.15.6:0/585560130 shutdown_connections 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 --2- 172.21.15.6:0/585560130 >> v2:172.21.15.89:3300/0 conn(0x7fa968148ad0 0x7fa96806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 --2- 172.21.15.6:0/585560130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa9680b5e50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 -- 172.21.15.6:0/585560130 >> 172.21.15.6:0/585560130 conn(0x7fa9680b8a00 msgr2=0x7fa9680b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 -- 172.21.15.6:0/585560130 shutdown_connections 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.363+0000 7fa96f23e640 1 -- 172.21.15.6:0/585560130 wait complete. 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.364+0000 7fa96f23e640 1 Processor -- start 2023-12-19T13:33:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.364+0000 7fa96f23e640 1 -- start start 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96f23e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa96809def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96f23e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 0x7fa968141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96f23e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa96809d880 0x7fa9681e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96f23e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96809e600 con 0x7fa9680b8470 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96f23e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96809e430 con 0x7fa96809d880 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96f23e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96809e940 con 0x7fa9680b8090 2023-12-19T13:33:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 0x7fa968141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 0x7fa968141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52434/0 (socket says 172.21.15.6:52434) 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 -- 172.21.15.6:0/4112836921 learned_addr learned my addr 172.21.15.6:0/4112836921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96d7db640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa96809d880 0x7fa9681e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa96cfda640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa96809def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 -- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 msgr2=0x7fa96809def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa96809def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 -- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa96809d880 msgr2=0x7fa9681e03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa96809d880 0x7fa9681e03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.365+0000 7fa967fff640 1 -- 172.21.15.6:0/4112836921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958009400 con 0x7fa9680b8470 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.366+0000 7fa967fff640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 0x7fa968141480 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00e870 tx=0x7fa95c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.366+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0094f0 con 0x7fa9680b8470 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.366+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c00c940 con 0x7fa9680b8470 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.366+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968145d60 con 0x7fa9680b8470 2023-12-19T13:33:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.366+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00ccf0 con 0x7fa9680b8470 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.366+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9681460f0 con 0x7fa9680b8470 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.367+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968070550 con 0x7fa9680b8470 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.367+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa95c013470 con 0x7fa9680b8470 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.368+0000 7fa9657fa640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa95406a430 0x7fa95406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.368+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa95c0888e0 con 0x7fa9680b8470 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.368+0000 7fa96cfda640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa95406a430 0x7fa95406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.368+0000 7fa96cfda640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa95406a430 0x7fa95406c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa958034000 tx=0x7fa95802f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.372+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa95c054010 con 0x7fa9680b8470 2023-12-19T13:33:25.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.549+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa968073a40 con 0x7fa9680b8470 2023-12-19T13:33:25.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.550+0000 7fa9657fa640 1 -- 172.21.15.6:0/4112836921 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa95c0170a0 con 0x7fa9680b8470 2023-12-19T13:33:25.552 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.551+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa95406a430 msgr2=0x7fa95406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.551+0000 7fa96f23e640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa95406a430 0x7fa95406c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa958034000 tx=0x7fa95802f000 comp rx=0 tx=0).stop 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.551+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 msgr2=0x7fa968141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.551+0000 7fa96f23e640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 0x7fa968141480 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00e870 tx=0x7fa95c00ed30 comp rx=0 tx=0).stop 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 shutdown_connections 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa95406a430 0x7fa95406c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa96809d880 0x7fa9681e03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9680b8470 0x7fa968141480 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 --2- 172.21.15.6:0/4112836921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9680b8090 0x7fa96809def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 >> 172.21.15.6:0/4112836921 conn(0x7fa9680b8a00 msgr2=0x7fa968148fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 shutdown_connections 2023-12-19T13:33:25.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.552+0000 7fa96f23e640 1 -- 172.21.15.6:0/4112836921 wait complete. 2023-12-19T13:33:25.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.670+0000 7fa62cd00640 1 Processor -- start 2023-12-19T13:33:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.670+0000 7fa62cd00640 1 -- start start 2023-12-19T13:33:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.671+0000 7fa62cd00640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa62814ebe0 0x7fa6281563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.671+0000 7fa62cd00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62814e040 con 0x7fa62806adf0 2023-12-19T13:33:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.671+0000 7fa62cd00640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280bb5d0 con 0x7fa6281416b0 2023-12-19T13:33:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.671+0000 7fa62cd00640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62806b3a0 con 0x7fa62814ebe0 2023-12-19T13:33:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.671+0000 7fa625d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa62806adf0 0x7fa62814e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57268/0 (socket says 172.21.15.6:57268) 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.671+0000 7fa625d9b640 1 -- 172.21.15.6:0/2662246859 learned_addr learned my addr 172.21.15.6:0/2662246859 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa626d9d640 1 --2- 172.21.15.6:0/2662246859 >> v2:172.21.15.89:3300/0 conn(0x7fa62814ebe0 0x7fa6281563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749136592 0 0) 0x7fa62814e040 con 0x7fa62806adf0 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa610003520 con 0x7fa62806adf0 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1793578853 0 0) 0x7fa610003520 con 0x7fa62806adf0 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 >> v2:172.21.15.89:3300/0 conn(0x7fa62814ebe0 msgr2=0x7fa6281563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 --2- 172.21.15.6:0/2662246859 >> v2:172.21.15.89:3300/0 conn(0x7fa62814ebe0 0x7fa6281563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 >> v1:172.21.15.89:6789/0 conn(0x7fa6281416b0 legacy=0x7fa6280baec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62806b680 con 0x7fa62806adf0 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fa61c001670 con 0x7fa62806adf0 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 >> v1:172.21.15.6:6789/0 conn(0x7fa62806adf0 legacy=0x7fa62814e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610003970 0x7fa610003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6100047c0 0x7fa610004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa610005180 0x7fa61000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62806b3a0 con 0x7fa6100047c0 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61000c020 con 0x7fa610003970 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61000c1e0 con 0x7fa610005180 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa625d9b640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6100047c0 0x7fa610004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa62659c640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610003970 0x7fa610003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa626d9d640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa610005180 0x7fa61000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa625d9b640 1 -- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa610005180 msgr2=0x7fa61000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa625d9b640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa610005180 0x7fa61000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa625d9b640 1 -- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610003970 msgr2=0x7fa610003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa625d9b640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610003970 0x7fa610003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa626d9d640 1 -- 172.21.15.6:0/2662246859 reap_dead start 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.672+0000 7fa625d9b640 1 -- 172.21.15.6:0/2662246859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610003520 con 0x7fa6100047c0 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.673+0000 7fa625d9b640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6100047c0 0x7fa610004c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c240 tx=0x7fa6100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c801c419b7df1984 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.673+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c005ad0 con 0x7fa6100047c0 2023-12-19T13:33:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.673+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c005c30 con 0x7fa6100047c0 2023-12-19T13:33:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.673+0000 7fa62559a640 1 -- 172.21.15.6:0/2662246859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c02ca90 con 0x7fa6100047c0 2023-12-19T13:33:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 -- 172.21.15.6:0/2662246859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6100047c0 msgr2=0x7fa610004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6100047c0 0x7fa610004c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c240 tx=0x7fa6100057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 -- 172.21.15.6:0/2662246859 shutdown_connections 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2662246859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6100047c0 0x7fa610004c40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 -- 172.21.15.6:0/2662246859 >> 172.21.15.6:0/2662246859 conn(0x7fa628069ee0 msgr2=0x7fa62806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 -- 172.21.15.6:0/2662246859 shutdown_connections 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.674+0000 7fa62cd00640 1 -- 172.21.15.6:0/2662246859 wait complete. 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.675+0000 7fa62cd00640 1 Processor -- start 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.675+0000 7fa62cd00640 1 -- start start 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100047c0 0x7fa6280b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa62813f4b0 0x7fa62813f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 0x7fa6281e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281d6dd0 con 0x7fa6281e3720 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281d4b00 con 0x7fa6100047c0 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b6760 con 0x7fa62813f4b0 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 0x7fa6281e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 0x7fa6281e3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52450/0 (socket says 172.21.15.6:52450) 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 -- 172.21.15.6:0/2978873870 learned_addr learned my addr 172.21.15.6:0/2978873870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62659c640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100047c0 0x7fa6280b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa625d9b640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa62813f4b0 0x7fa62813f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 -- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa62813f4b0 msgr2=0x7fa62813f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa62813f4b0 0x7fa62813f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 -- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100047c0 msgr2=0x7fa6280b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100047c0 0x7fa6280b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 -- 172.21.15.6:0/2978873870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62813fe50 con 0x7fa6281e3720 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62659c640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100047c0 0x7fa6280b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa626d9d640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 0x7fa6281e3ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b87f0 tx=0x7fa62000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62000e040 con 0x7fa6281e3720 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62000f040 con 0x7fa6281e3720 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6281e40e0 con 0x7fa6281e3720 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.676+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620015430 con 0x7fa6281e3720 2023-12-19T13:33:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.677+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62814b520 con 0x7fa6281e3720 2023-12-19T13:33:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.678+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62806be10 con 0x7fa6281e3720 2023-12-19T13:33:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.678+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa620015590 con 0x7fa6281e3720 2023-12-19T13:33:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.678+0000 7fa616ffd640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa60806a460 0x7fa60806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.678+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa620089320 con 0x7fa6281e3720 2023-12-19T13:33:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.679+0000 7fa62659c640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa60806a460 0x7fa60806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.679+0000 7fa62659c640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa60806a460 0x7fa60806c920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa628069510 tx=0x7fa618009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.683+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa6200549a0 con 0x7fa6281e3720 2023-12-19T13:33:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.858+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6280bbf70 con 0x7fa6281e3720 2023-12-19T13:33:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.858+0000 7fa616ffd640 1 -- 172.21.15.6:0/2978873870 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6280bbf70 con 0x7fa6281e3720 2023-12-19T13:33:25.860 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa60806a460 msgr2=0x7fa60806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa60806a460 0x7fa60806c920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa628069510 tx=0x7fa618009040 comp rx=0 tx=0).stop 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 msgr2=0x7fa6281e3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 0x7fa6281e3ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b87f0 tx=0x7fa62000f1b0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 shutdown_connections 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa60806a460 0x7fa60806c920 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6281e3720 0x7fa6281e3ba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa62813f4b0 0x7fa62813f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 --2- 172.21.15.6:0/2978873870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100047c0 0x7fa6280b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 >> 172.21.15.6:0/2978873870 conn(0x7fa628069ee0 msgr2=0x7fa6280b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 shutdown_connections 2023-12-19T13:33:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.860+0000 7fa62cd00640 1 -- 172.21.15.6:0/2978873870 wait complete. 2023-12-19T13:33:25.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:25.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.980+0000 7f064b4a1640 1 Processor -- start 2023-12-19T13:33:25.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.980+0000 7f064b4a1640 1 -- start start 2023-12-19T13:33:25.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064b4a1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06440b8690 0x7f06440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064b4a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0644144d80 0x7f064414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064b4a1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064414ab10 con 0x7f06440b77d0 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064b4a1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064406c2f0 con 0x7f06440b8690 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064b4a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440ba620 con 0x7f0644144d80 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064923d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06440b8690 0x7f06440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f0648a3c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06440b77d0 0x7f0644144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57276/0 (socket says 172.21.15.6:57276) 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f0648a3c640 1 -- 172.21.15.6:0/4208924360 learned_addr learned my addr 172.21.15.6:0/4208924360 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f0649a3e640 1 --2- 172.21.15.6:0/4208924360 >> v2:172.21.15.89:3300/0 conn(0x7f0644144d80 0x7f064414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064923d640 1 -- 172.21.15.6:0/4208924360 >> v2:172.21.15.89:3300/0 conn(0x7f0644144d80 msgr2=0x7f064414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064923d640 1 --2- 172.21.15.6:0/4208924360 >> v2:172.21.15.89:3300/0 conn(0x7f0644144d80 0x7f064414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064923d640 1 -- 172.21.15.6:0/4208924360 >> v1:172.21.15.6:6789/0 conn(0x7f06440b77d0 legacy=0x7f0644144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f0643fff640 1 -- 172.21.15.6:0/4208924360 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184664509 0 0) 0x7f064414ab10 con 0x7f06440b77d0 2023-12-19T13:33:25.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.981+0000 7f064923d640 1 -- 172.21.15.6:0/4208924360 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440b9e60 con 0x7f06440b8690 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.982+0000 7f064923d640 1 --2- 172.21.15.6:0/4208924360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06440b8690 0x7f06440b8a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f06440bde70 tx=0x7f063c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b40fba5c18f1e01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.982+0000 7f0643fff640 1 -- 172.21.15.6:0/4208924360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c02cbf0 con 0x7f06440b8690 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.982+0000 7f0643fff640 1 -- 172.21.15.6:0/4208924360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c02cd50 con 0x7f06440b8690 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.982+0000 7f0643fff640 1 -- 172.21.15.6:0/4208924360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c034660 con 0x7f06440b8690 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 -- 172.21.15.6:0/4208924360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06440b8690 msgr2=0x7f06440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 --2- 172.21.15.6:0/4208924360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06440b8690 0x7f06440b8a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f06440bde70 tx=0x7f063c02be40 comp rx=0 tx=0).stop 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 -- 172.21.15.6:0/4208924360 shutdown_connections 2023-12-19T13:33:25.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 --2- 172.21.15.6:0/4208924360 >> v2:172.21.15.89:3300/0 conn(0x7f0644144d80 0x7f064414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 --2- 172.21.15.6:0/4208924360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06440b8690 0x7f06440b8a70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 -- 172.21.15.6:0/4208924360 >> 172.21.15.6:0/4208924360 conn(0x7f064406b6a0 msgr2=0x7f064406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 -- 172.21.15.6:0/4208924360 shutdown_connections 2023-12-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.983+0000 7f064b4a1640 1 -- 172.21.15.6:0/4208924360 wait complete. 2023-12-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.984+0000 7f064b4a1640 1 Processor -- start 2023-12-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.984+0000 7f064b4a1640 1 -- start start 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.984+0000 7f064b4a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06440b77d0 0x7f0644147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.984+0000 7f064b4a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06440b8690 0x7f06441e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.984+0000 7f064b4a1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 0x7f06441e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.984+0000 7f064b4a1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06441483b0 con 0x7f0644144d80 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f064b4a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644149f30 con 0x7f06440b77d0 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f064b4a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06441dfc60 con 0x7f06440b8690 2023-12-19T13:33:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 0x7f06441e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 0x7f06441e0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52466/0 (socket says 172.21.15.6:52466) 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 -- 172.21.15.6:0/2287199272 learned_addr learned my addr 172.21.15.6:0/2287199272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0648a3c640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06440b8690 0x7f06441e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f064923d640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06440b77d0 0x7f0644147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 -- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06440b8690 msgr2=0x7f06441e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06440b8690 0x7f06441e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 -- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06440b77d0 msgr2=0x7f0644147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06440b77d0 0x7f0644147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 -- 172.21.15.6:0/2287199272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009a70 con 0x7f0644144d80 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0648a3c640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06440b8690 0x7f06441e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0649a3e640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 0x7f06441e0630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f063400d5d0 tx=0x7f063400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340125f0 con 0x7f0644144d80 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634012770 con 0x7f0644144d80 2023-12-19T13:33:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634012b20 con 0x7f0644144d80 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.985+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064414a180 con 0x7f0644144d80 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.986+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644149500 con 0x7f0644144d80 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.986+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0644073a40 con 0x7f0644144d80 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.987+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0634012c80 con 0x7f0644144d80 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.987+0000 7f0641ffb640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f063006a460 0x7f063006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.987+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0634088d30 con 0x7f0644144d80 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.987+0000 7f064923d640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f063006a460 0x7f063006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.988+0000 7f064923d640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f063006a460 0x7f063006c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f063c036000 tx=0x7f063c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:25.992+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0634054330 con 0x7f0644144d80 2023-12-19T13:33:26.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.166+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06441dfda0 con 0x7f0644144d80 2023-12-19T13:33:26.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.166+0000 7f0641ffb640 1 -- 172.21.15.6:0/2287199272 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0634057950 con 0x7f0644144d80 2023-12-19T13:33:26.168 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.168+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f063006a460 msgr2=0x7f063006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.168+0000 7f064b4a1640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f063006a460 0x7f063006c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f063c036000 tx=0x7f063c030000 comp rx=0 tx=0).stop 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.168+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 msgr2=0x7f06441e0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.168+0000 7f064b4a1640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 0x7f06441e0630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f063400d5d0 tx=0x7f063400da90 comp rx=0 tx=0).stop 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 shutdown_connections 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f063006a460 0x7f063006c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644144d80 0x7f06441e0630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06440b8690 0x7f06441e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 --2- 172.21.15.6:0/2287199272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06440b77d0 0x7f0644147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 >> 172.21.15.6:0/2287199272 conn(0x7f064406b6a0 msgr2=0x7f06441424e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 shutdown_connections 2023-12-19T13:33:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.169+0000 7f064b4a1640 1 -- 172.21.15.6:0/2287199272 wait complete. 2023-12-19T13:33:26.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 Processor -- start 2023-12-19T13:33:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 -- start start 2023-12-19T13:33:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f522014aed0 0x7f522014b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52201534d0 0x7f52201558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5220145340 con 0x7f52200b7cc0 2023-12-19T13:33:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522006c970 con 0x7f522014aed0 2023-12-19T13:33:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.285+0000 7f5225619640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200b80a0 con 0x7f52201534d0 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52201534d0 0x7f52201558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f5217fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f522014aed0 0x7f522014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f521effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f52200b7cc0 0x7f5220070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:59094/0 (socket says 172.21.15.6:59094) 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52201534d0 0x7f52201558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:55540/0 (socket says 172.21.15.6:55540) 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f521effd640 1 -- 172.21.15.6:0/3141434722 learned_addr learned my addr 172.21.15.6:0/3141434722 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f5217fff640 1 -- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52201534d0 msgr2=0x7f52201558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f5217fff640 1 --2- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52201534d0 0x7f52201558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f5217fff640 1 -- 172.21.15.6:0/3141434722 >> v1:172.21.15.89:6789/0 conn(0x7f52200b7cc0 legacy=0x7f5220070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f521e7fc640 1 -- 172.21.15.6:0/3141434722 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674007503 0 0) 0x7f5220145340 con 0x7f52200b7cc0 2023-12-19T13:33:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.286+0000 7f5217fff640 1 -- 172.21.15.6:0/3141434722 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200715d0 con 0x7f522014aed0 2023-12-19T13:33:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.287+0000 7f5217fff640 1 --2- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f522014aed0 0x7f522014b310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52080097a0 tx=0x7f520802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169aeea9d0ea53fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.287+0000 7f521e7fc640 1 -- 172.21.15.6:0/3141434722 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520802e070 con 0x7f522014aed0 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.287+0000 7f521e7fc640 1 -- 172.21.15.6:0/3141434722 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52080315a0 con 0x7f522014aed0 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.287+0000 7f521e7fc640 1 -- 172.21.15.6:0/3141434722 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208031930 con 0x7f522014aed0 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 -- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f522014aed0 msgr2=0x7f522014b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 --2- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f522014aed0 0x7f522014b310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52080097a0 tx=0x7f520802b840 comp rx=0 tx=0).stop 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 -- 172.21.15.6:0/3141434722 shutdown_connections 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 --2- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f522014aed0 0x7f522014b310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 --2- 172.21.15.6:0/3141434722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52201534d0 0x7f52201558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 -- 172.21.15.6:0/3141434722 >> 172.21.15.6:0/3141434722 conn(0x7f52200be150 msgr2=0x7f52200be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 -- 172.21.15.6:0/3141434722 shutdown_connections 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.288+0000 7f5225619640 1 -- 172.21.15.6:0/3141434722 wait complete. 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 Processor -- start 2023-12-19T13:33:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 -- start start 2023-12-19T13:33:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 0x7f52201e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f522014aed0 0x7f5220141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52201534d0 0x7f5220141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52201e3aa0 con 0x7f52200b7cc0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220152f80 con 0x7f52201534d0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.289+0000 7f5225619640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52201531d0 con 0x7f522014aed0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 0x7f52201e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 0x7f52201e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52470/0 (socket says 172.21.15.6:52470) 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 -- 172.21.15.6:0/438539302 learned_addr learned my addr 172.21.15.6:0/438539302 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521f7fe640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52201534d0 0x7f5220141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f5217fff640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f522014aed0 0x7f5220141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 -- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f522014aed0 msgr2=0x7f5220141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f522014aed0 0x7f5220141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 -- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52201534d0 msgr2=0x7f5220141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52201534d0 0x7f5220141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 -- 172.21.15.6:0/438539302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009400 con 0x7f52200b7cc0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f521effd640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 0x7f52201e3560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f521000c460 tx=0x7f521000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100074e0 con 0x7f52200b7cc0 2023-12-19T13:33:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210007660 con 0x7f52200b7cc0 2023-12-19T13:33:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5220146670 con 0x7f52200b7cc0 2023-12-19T13:33:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210004a20 con 0x7f52200b7cc0 2023-12-19T13:33:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.290+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5220146c30 con 0x7f52200b7cc0 2023-12-19T13:33:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.291+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52200bee10 con 0x7f52200b7cc0 2023-12-19T13:33:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.292+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5210004b80 con 0x7f52200b7cc0 2023-12-19T13:33:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.292+0000 7f52177fe640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f520006a430 0x7f520006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.292+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5210088590 con 0x7f52200b7cc0 2023-12-19T13:33:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.292+0000 7f5217fff640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f520006a430 0x7f520006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.293+0000 7f5217fff640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f520006a430 0x7f520006c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5208036000 tx=0x7f520803e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.296+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5210053c30 con 0x7f52200b7cc0 2023-12-19T13:33:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.475+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5220073a40 con 0x7f52200b7cc0 2023-12-19T13:33:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.476+0000 7f52177fe640 1 -- 172.21.15.6:0/438539302 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f5210057250 con 0x7f52200b7cc0 2023-12-19T13:33:26.478 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:26.478 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f520006a430 msgr2=0x7f520006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f520006a430 0x7f520006c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5208036000 tx=0x7f520803e040 comp rx=0 tx=0).stop 2023-12-19T13:33:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 msgr2=0x7f52201e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 0x7f52201e3560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f521000c460 tx=0x7f521000c920 comp rx=0 tx=0).stop 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 shutdown_connections 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f520006a430 0x7f520006c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52201534d0 0x7f5220141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f522014aed0 0x7f5220141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 --2- 172.21.15.6:0/438539302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52200b7cc0 0x7f52201e3560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 >> 172.21.15.6:0/438539302 conn(0x7f52200be150 msgr2=0x7f52201420c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 shutdown_connections 2023-12-19T13:33:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.478+0000 7f5225619640 1 -- 172.21.15.6:0/438539302 wait complete. 2023-12-19T13:33:26.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:26.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:26.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.597+0000 7f45644df640 1 Processor -- start 2023-12-19T13:33:26.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.597+0000 7f45644df640 1 -- start start 2023-12-19T13:33:26.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f45644df640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b8690 0x7f455c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f45644df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f455c0b77d0 0x7f455c144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f45644df640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f455c144bb0 0x7f455c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f45644df640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455c14ab10 con 0x7f455c144bb0 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f45644df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455c06c2f0 con 0x7f455c0b77d0 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f45644df640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c0ba620 con 0x7f455c0b8690 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f455c144bb0 0x7f455c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f455c144bb0 0x7f455c14afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44650/0 (socket says 172.21.15.6:44650) 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 -- 172.21.15.6:0/870865397 learned_addr learned my addr 172.21.15.6:0/870865397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f456227b640 1 --2- 172.21.15.6:0/870865397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b8690 0x7f455c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4561a7a640 1 --2- 172.21.15.6:0/870865397 >> v2:172.21.15.89:3300/0 conn(0x7f455c0b77d0 0x7f455c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 -- 172.21.15.6:0/870865397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b8690 msgr2=0x7f455c0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 --2- 172.21.15.6:0/870865397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b8690 0x7f455c0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 -- 172.21.15.6:0/870865397 >> v2:172.21.15.89:3300/0 conn(0x7f455c0b77d0 msgr2=0x7f455c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 --2- 172.21.15.6:0/870865397 >> v2:172.21.15.89:3300/0 conn(0x7f455c0b77d0 0x7f455c144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4562a7c640 1 -- 172.21.15.6:0/870865397 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c0b9e60 con 0x7f455c144bb0 2023-12-19T13:33:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.598+0000 7f4561a7a640 1 --2- 172.21.15.6:0/870865397 >> v2:172.21.15.89:3300/0 conn(0x7f455c0b77d0 0x7f455c144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.599+0000 7f4562a7c640 1 --2- 172.21.15.6:0/870865397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c14afa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f455c08a260 tx=0x7f454c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cdb9b107809d9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.599+0000 7f4561279640 1 -- 172.21.15.6:0/870865397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c02c9e0 con 0x7f455c144bb0 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.599+0000 7f4561279640 1 -- 172.21.15.6:0/870865397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c02cb40 con 0x7f455c144bb0 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.599+0000 7f4561279640 1 -- 172.21.15.6:0/870865397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c0343f0 con 0x7f455c144bb0 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 -- 172.21.15.6:0/870865397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 msgr2=0x7f455c14afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 --2- 172.21.15.6:0/870865397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c14afa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f455c08a260 tx=0x7f454c02be40 comp rx=0 tx=0).stop 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 -- 172.21.15.6:0/870865397 shutdown_connections 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 --2- 172.21.15.6:0/870865397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c14afa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 --2- 172.21.15.6:0/870865397 >> v2:172.21.15.89:3300/0 conn(0x7f455c0b77d0 0x7f455c144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 --2- 172.21.15.6:0/870865397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b8690 0x7f455c0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 -- 172.21.15.6:0/870865397 >> 172.21.15.6:0/870865397 conn(0x7f455c06b6a0 msgr2=0x7f455c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 -- 172.21.15.6:0/870865397 shutdown_connections 2023-12-19T13:33:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.600+0000 7f45644df640 1 -- 172.21.15.6:0/870865397 wait complete. 2023-12-19T13:33:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.601+0000 7f45644df640 1 Processor -- start 2023-12-19T13:33:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.601+0000 7f45644df640 1 -- start start 2023-12-19T13:33:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b77d0 0x7f455c145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f455c0b8690 0x7f455c146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c1e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c145740 con 0x7f455c144bb0 2023-12-19T13:33:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c147110 con 0x7f455c0b8690 2023-12-19T13:33:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c1473c0 con 0x7f455c0b77d0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c1e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c1e3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44662/0 (socket says 172.21.15.6:44662) 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 -- 172.21.15.6:0/810631867 learned_addr learned my addr 172.21.15.6:0/810631867 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f456227b640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b77d0 0x7f455c145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4561a7a640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f455c0b8690 0x7f455c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 -- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b77d0 msgr2=0x7f455c145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b77d0 0x7f455c145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 -- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f455c0b8690 msgr2=0x7f455c146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f455c0b8690 0x7f455c146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 -- 172.21.15.6:0/810631867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c009b30 con 0x7f455c144bb0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f4562a7c640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c1e3300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f454c009f40 tx=0x7f454c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c009510 con 0x7f455c144bb0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c03e450 con 0x7f455c144bb0 2023-12-19T13:33:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455c147700 con 0x7f455c144bb0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c03e7e0 con 0x7f455c144bb0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.602+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c146c70 con 0x7f455c144bb0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.603+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c147530 con 0x7f455c144bb0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.604+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f454c03e940 con 0x7f455c144bb0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.604+0000 7f455affd640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f454806a430 0x7f454806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.604+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f454c0ab770 con 0x7f455c144bb0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.604+0000 7f456227b640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f454806a430 0x7f454806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.605+0000 7f456227b640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f454806a430 0x7f454806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4554006fd0 tx=0x7f4554008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.608+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f454c076cc0 con 0x7f455c144bb0 2023-12-19T13:33:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.783+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f455c073a40 con 0x7f455c144bb0 2023-12-19T13:33:26.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.784+0000 7f455affd640 1 -- 172.21.15.6:0/810631867 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f454c07a2e0 con 0x7f455c144bb0 2023-12-19T13:33:26.786 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:26.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f454806a430 msgr2=0x7f454806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f454806a430 0x7f454806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4554006fd0 tx=0x7f4554008040 comp rx=0 tx=0).stop 2023-12-19T13:33:26.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 msgr2=0x7f455c1e3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c1e3300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f454c009f40 tx=0x7f454c004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 shutdown_connections 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f454806a430 0x7f454806c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f455c144bb0 0x7f455c1e3300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f455c0b8690 0x7f455c146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 --2- 172.21.15.6:0/810631867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f455c0b77d0 0x7f455c145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 >> 172.21.15.6:0/810631867 conn(0x7f455c06b6a0 msgr2=0x7f455c14af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 shutdown_connections 2023-12-19T13:33:26.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.786+0000 7f45644df640 1 -- 172.21.15.6:0/810631867 wait complete. 2023-12-19T13:33:26.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.906+0000 7f0b0fd95640 1 Processor -- start 2023-12-19T13:33:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.906+0000 7f0b0fd95640 1 -- start start 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0fd95640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b080b77c0 0x7f0b081564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0fd95640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b080b6f30 con 0x7f0b080b81f0 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0fd95640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b080b96a0 con 0x7f0b08144ff0 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0fd95640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b080bc740 con 0x7f0b080b77c0 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0e332640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b080b77c0 0x7f0b081564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0d330640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b080b81f0 0x7f0b0814e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58642/0 (socket says 172.21.15.6:58642) 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0d330640 1 -- 172.21.15.6:0/3188798492 learned_addr learned my addr 172.21.15.6:0/3188798492 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0e332640 1 -- 172.21.15.6:0/3188798492 >> v1:172.21.15.89:6789/0 conn(0x7f0b08144ff0 legacy=0x7f0b080bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0e332640 1 -- 172.21.15.6:0/3188798492 >> v1:172.21.15.6:6789/0 conn(0x7f0b080b81f0 legacy=0x7f0b0814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0cb2f640 1 -- 172.21.15.6:0/3188798492 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927376736 0 0) 0x7f0af8001110 con 0x7f0b080b81f0 2023-12-19T13:33:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.907+0000 7f0b0e332640 1 -- 172.21.15.6:0/3188798492 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080b8c50 con 0x7f0b080b77c0 2023-12-19T13:33:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0e332640 1 --2- 172.21.15.6:0/3188798492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b77c0 0x7f0b081564d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009d90 tx=0x7f0b0002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db97c964260d036 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0cb2f640 1 -- 172.21.15.6:0/3188798492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0002cd00 con 0x7f0b080b77c0 2023-12-19T13:33:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0cb2f640 1 -- 172.21.15.6:0/3188798492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0002ce60 con 0x7f0b080b77c0 2023-12-19T13:33:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0cb2f640 1 -- 172.21.15.6:0/3188798492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00034660 con 0x7f0b080b77c0 2023-12-19T13:33:26.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0fd95640 1 -- 172.21.15.6:0/3188798492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b77c0 msgr2=0x7f0b081564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/3188798492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b77c0 0x7f0b081564d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009d90 tx=0x7f0b0002bf50 comp rx=0 tx=0).stop 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0fd95640 1 -- 172.21.15.6:0/3188798492 shutdown_connections 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.908+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/3188798492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b77c0 0x7f0b081564d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.909+0000 7f0b0fd95640 1 -- 172.21.15.6:0/3188798492 >> 172.21.15.6:0/3188798492 conn(0x7f0b08071610 msgr2=0x7f0b080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.909+0000 7f0b0fd95640 1 -- 172.21.15.6:0/3188798492 shutdown_connections 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.909+0000 7f0b0fd95640 1 -- 172.21.15.6:0/3188798492 wait complete. 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 Processor -- start 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 -- start start 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b080b77c0 0x7f0b080b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 0x7f0b080ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b08144ff0 0x7f0b081dff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080b2c10 con 0x7f0b080b81f0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080afa60 con 0x7f0b08144ff0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0fd95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080ae040 con 0x7f0b080b77c0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0d330640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 0x7f0b080ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0d330640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 0x7f0b080ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44670/0 (socket says 172.21.15.6:44670) 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.910+0000 7f0b0d330640 1 -- 172.21.15.6:0/829984357 learned_addr learned my addr 172.21.15.6:0/829984357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0e332640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b08144ff0 0x7f0b081dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0db31640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b080b77c0 0x7f0b080b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0d330640 1 -- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b080b77c0 msgr2=0x7f0b080b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0d330640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b080b77c0 0x7f0b080b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0d330640 1 -- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b08144ff0 msgr2=0x7f0b081dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0d330640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b08144ff0 0x7f0b081dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0d330640 1 -- 172.21.15.6:0/829984357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00009a70 con 0x7f0b080b81f0 2023-12-19T13:33:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0e332640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b08144ff0 0x7f0b081dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0d330640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 0x7f0b080ae4d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c7b0 tx=0x7f0af800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af80072d0 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8007450 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b080add60 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8001d10 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.911+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b080b0a10 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.912+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b080afcc0 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.912+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0af80047e0 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.913+0000 7f0afe7fc640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0aec06a430 0x7f0aec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.913+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0af8087c70 con 0x7f0b080b81f0 2023-12-19T13:33:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.913+0000 7f0b0db31640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0aec06a430 0x7f0aec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:26.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.913+0000 7f0b0db31640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0aec06a430 0x7f0aec06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000f60 tx=0x7f0b04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:26.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:26.917+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0af80532f0 con 0x7f0b080b81f0 2023-12-19T13:33:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.091+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b080b6f30 con 0x7f0b080b81f0 2023-12-19T13:33:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.091+0000 7f0afe7fc640 1 -- 172.21.15.6:0/829984357 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0af8018020 con 0x7f0b080b81f0 2023-12-19T13:33:27.093 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:27.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0aec06a430 msgr2=0x7f0aec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0aec06a430 0x7f0aec06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000f60 tx=0x7f0b04009040 comp rx=0 tx=0).stop 2023-12-19T13:33:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 msgr2=0x7f0b080ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 0x7f0b080ae4d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c7b0 tx=0x7f0af800cc70 comp rx=0 tx=0).stop 2023-12-19T13:33:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 shutdown_connections 2023-12-19T13:33:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0aec06a430 0x7f0aec06c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b08144ff0 0x7f0b081dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b080b81f0 0x7f0b080ae4d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 --2- 172.21.15.6:0/829984357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b080b77c0 0x7f0b080b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 >> 172.21.15.6:0/829984357 conn(0x7f0b08071610 msgr2=0x7f0b080c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:27.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 shutdown_connections 2023-12-19T13:33:27.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.093+0000 7f0b0fd95640 1 -- 172.21.15.6:0/829984357 wait complete. 2023-12-19T13:33:27.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 Processor -- start 2023-12-19T13:33:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 -- start start 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7880b7a10 0x7fb788069d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb78806fe30 0x7fb7881554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880b8040 con 0x7fb788145090 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb788070b50 con 0x7fb7880b7a10 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.213+0000 7fb78fbd0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880b9860 con 0x7fb78806fe30 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7880b7a10 0x7fb788069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7880b7a10 0x7fb788069d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44674/0 (socket says 172.21.15.6:44674) 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 -- 172.21.15.6:0/3870226974 learned_addr learned my addr 172.21.15.6:0/3870226974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78e16d640 1 --2- 172.21.15.6:0/3870226974 >> v2:172.21.15.89:3300/0 conn(0x7fb78806fe30 0x7fb7881554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 -- 172.21.15.6:0/3870226974 >> v2:172.21.15.89:3300/0 conn(0x7fb78806fe30 msgr2=0x7fb7881554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 --2- 172.21.15.6:0/3870226974 >> v2:172.21.15.89:3300/0 conn(0x7fb78806fe30 0x7fb7881554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 -- 172.21.15.6:0/3870226974 >> v1:172.21.15.89:6789/0 conn(0x7fb788145090 legacy=0x7fb7880b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.214+0000 7fb78d16b640 1 -- 172.21.15.6:0/3870226974 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880719f0 con 0x7fb7880b7a10 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78d16b640 1 --2- 172.21.15.6:0/3870226974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7880b7a10 0x7fb788069d00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb78806c380 tx=0x7fb77802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50af1bb2edcbf41a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78c96a640 1 -- 172.21.15.6:0/3870226974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778031870 con 0x7fb7880b7a10 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78c96a640 1 -- 172.21.15.6:0/3870226974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7780319d0 con 0x7fb7880b7a10 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78c96a640 1 -- 172.21.15.6:0/3870226974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778031d60 con 0x7fb7880b7a10 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78fbd0640 1 -- 172.21.15.6:0/3870226974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7880b7a10 msgr2=0x7fb788069d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/3870226974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7880b7a10 0x7fb788069d00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb78806c380 tx=0x7fb77802b910 comp rx=0 tx=0).stop 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78fbd0640 1 -- 172.21.15.6:0/3870226974 shutdown_connections 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/3870226974 >> v2:172.21.15.89:3300/0 conn(0x7fb78806fe30 0x7fb7881554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/3870226974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7880b7a10 0x7fb788069d00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.215+0000 7fb78fbd0640 1 -- 172.21.15.6:0/3870226974 >> 172.21.15.6:0/3870226974 conn(0x7fb7880bd090 msgr2=0x7fb7880bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.216+0000 7fb78fbd0640 1 -- 172.21.15.6:0/3870226974 shutdown_connections 2023-12-19T13:33:27.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.216+0000 7fb78fbd0640 1 -- 172.21.15.6:0/3870226974 wait complete. 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 Processor -- start 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 -- start start 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 0x7fb7880b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788145090 0x7fb7880b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7880b6300 0x7fb7880b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881e4240 con 0x7fb78806fe30 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880b4510 con 0x7fb788145090 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78fbd0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881e3c80 con 0x7fb7880b6300 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78d96c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 0x7fb7880b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78d96c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 0x7fb7880b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44686/0 (socket says 172.21.15.6:44686) 2023-12-19T13:33:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.217+0000 7fb78d96c640 1 -- 172.21.15.6:0/1266831998 learned_addr learned my addr 172.21.15.6:0/1266831998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78e16d640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7880b6300 0x7fb7880b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d16b640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788145090 0x7fb7880b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d96c640 1 -- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7880b6300 msgr2=0x7fb7880b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d96c640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7880b6300 0x7fb7880b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d96c640 1 -- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788145090 msgr2=0x7fb7880b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d96c640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788145090 0x7fb7880b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d96c640 1 -- 172.21.15.6:0/1266831998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780094d0 con 0x7fb78806fe30 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d16b640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788145090 0x7fb7880b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78d96c640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 0x7fb7880b5dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb78400b3f0 tx=0x7fb78400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011830 con 0x7fb78806fe30 2023-12-19T13:33:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784011990 con 0x7fb78806fe30 2023-12-19T13:33:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7881e3f60 con 0x7fb78806fe30 2023-12-19T13:33:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011d40 con 0x7fb78806fe30 2023-12-19T13:33:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.218+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb788069f00 con 0x7fb78806fe30 2023-12-19T13:33:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.219+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880b42e0 con 0x7fb78806fe30 2023-12-19T13:33:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.219+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb78401a400 con 0x7fb78806fe30 2023-12-19T13:33:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.220+0000 7fb77e7fc640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb76c06a460 0x7fb76c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.220+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb784088800 con 0x7fb78806fe30 2023-12-19T13:33:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.220+0000 7fb78d16b640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb76c06a460 0x7fb76c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.220+0000 7fb78d16b640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb76c06a460 0x7fb76c06c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb778036000 tx=0x7fb77803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.224+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb7880b42e0 con 0x7fb78806fe30 2023-12-19T13:33:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.398+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7880b42e0 con 0x7fb78806fe30 2023-12-19T13:33:27.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.399+0000 7fb77e7fc640 1 -- 172.21.15.6:0/1266831998 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7880b42e0 con 0x7fb78806fe30 2023-12-19T13:33:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb76c06a460 msgr2=0x7fb76c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb76c06a460 0x7fb76c06c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb778036000 tx=0x7fb77803c040 comp rx=0 tx=0).stop 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 msgr2=0x7fb7880b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 0x7fb7880b5dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb78400b3f0 tx=0x7fb78400b8b0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 shutdown_connections 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb76c06a460 0x7fb76c06c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7880b6300 0x7fb7880b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.400+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788145090 0x7fb7880b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.401+0000 7fb78fbd0640 1 --2- 172.21.15.6:0/1266831998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78806fe30 0x7fb7880b5dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.401+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 >> 172.21.15.6:0/1266831998 conn(0x7fb7880bd090 msgr2=0x7fb7880bc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.401+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 shutdown_connections 2023-12-19T13:33:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.401+0000 7fb78fbd0640 1 -- 172.21.15.6:0/1266831998 wait complete. 2023-12-19T13:33:27.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:27.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.517+0000 7f16f8f00640 1 Processor -- start 2023-12-19T13:33:27.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.517+0000 7f16f8f00640 1 -- start start 2023-12-19T13:33:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f8f00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f406a6d0 0x7f16f414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f8f00640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16f414b1f0 0x7f16f40b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f8f00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16f40ba550 0x7f16f414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f8f00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40bb310 con 0x7f16f40ba550 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f8f00640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40bf960 con 0x7f16f414b1f0 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f8f00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40bb5b0 con 0x7f16f406a6d0 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16f40ba550 0x7f16f414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16f40ba550 0x7f16f414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44692/0 (socket says 172.21.15.6:44692) 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 -- 172.21.15.6:0/383693820 learned_addr learned my addr 172.21.15.6:0/383693820 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f259c640 1 --2- 172.21.15.6:0/383693820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f406a6d0 0x7f16f414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f1d9b640 1 --2- 172.21.15.6:0/383693820 >> v2:172.21.15.89:3300/0 conn(0x7f16f414b1f0 0x7f16f40b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 -- 172.21.15.6:0/383693820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f406a6d0 msgr2=0x7f16f414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 --2- 172.21.15.6:0/383693820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f406a6d0 0x7f16f414acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 -- 172.21.15.6:0/383693820 >> v2:172.21.15.89:3300/0 conn(0x7f16f414b1f0 msgr2=0x7f16f40b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 --2- 172.21.15.6:0/383693820 >> v2:172.21.15.89:3300/0 conn(0x7f16f414b1f0 0x7f16f40b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f2d9d640 1 -- 172.21.15.6:0/383693820 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40c0120 con 0x7f16f40ba550 2023-12-19T13:33:27.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.518+0000 7f16f1d9b640 1 --2- 172.21.15.6:0/383693820 >> v2:172.21.15.89:3300/0 conn(0x7f16f414b1f0 0x7f16f40b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.519+0000 7f16f2d9d640 1 --2- 172.21.15.6:0/383693820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f414e1b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16f406bc40 tx=0x7f16e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429cda378502c578 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.519+0000 7f16f159a640 1 -- 172.21.15.6:0/383693820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e402ca70 con 0x7f16f40ba550 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.519+0000 7f16f159a640 1 -- 172.21.15.6:0/383693820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e402cbd0 con 0x7f16f40ba550 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.519+0000 7f16f159a640 1 -- 172.21.15.6:0/383693820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40343f0 con 0x7f16f40ba550 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 -- 172.21.15.6:0/383693820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 msgr2=0x7f16f414e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 --2- 172.21.15.6:0/383693820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f414e1b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16f406bc40 tx=0x7f16e402bed0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 -- 172.21.15.6:0/383693820 shutdown_connections 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 --2- 172.21.15.6:0/383693820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f414e1b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 --2- 172.21.15.6:0/383693820 >> v2:172.21.15.89:3300/0 conn(0x7f16f414b1f0 0x7f16f40b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 --2- 172.21.15.6:0/383693820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f406a6d0 0x7f16f414acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 -- 172.21.15.6:0/383693820 >> 172.21.15.6:0/383693820 conn(0x7f16f40c0350 msgr2=0x7f16f40c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 -- 172.21.15.6:0/383693820 shutdown_connections 2023-12-19T13:33:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.520+0000 7f16f8f00640 1 -- 172.21.15.6:0/383693820 wait complete. 2023-12-19T13:33:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.521+0000 7f16f8f00640 1 Processor -- start 2023-12-19T13:33:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.521+0000 7f16f8f00640 1 -- start start 2023-12-19T13:33:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16f406a6d0 0x7f16f40a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f41e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f414b1f0 0x7f16f4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40a5c20 con 0x7f16f40ba550 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4099560 con 0x7f16f406a6d0 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4099840 con 0x7f16f414b1f0 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f41e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f41e3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44702/0 (socket says 172.21.15.6:44702) 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 -- 172.21.15.6:0/2091933486 learned_addr learned my addr 172.21.15.6:0/2091933486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f2d9d640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f414b1f0 0x7f16f4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f259c640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16f406a6d0 0x7f16f40a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 -- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f414b1f0 msgr2=0x7f16f4145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f414b1f0 0x7f16f4145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 -- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16f406a6d0 msgr2=0x7f16f40a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16f406a6d0 0x7f16f40a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 -- 172.21.15.6:0/2091933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009b30 con 0x7f16f40ba550 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f2d9d640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f414b1f0 0x7f16f4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f1d9b640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f41e3450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00d830 tx=0x7f16dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc004030 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc004190 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f40b6b70 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00b660 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.522+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f40b6e10 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.523+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f4073a40 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.524+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16dc00b7c0 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.524+0000 7f16eaffd640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f16d406a430 0x7f16d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.524+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16dc088a90 con 0x7f16f40ba550 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.525+0000 7f16f259c640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f16d406a430 0x7f16d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.525+0000 7f16f259c640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f16d406a430 0x7f16d406c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009990 tx=0x7f16ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.529+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f16dc054070 con 0x7f16f40ba550 2023-12-19T13:33:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.704+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f40a1860 con 0x7f16f40ba550 2023-12-19T13:33:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.706+0000 7f16eaffd640 1 -- 172.21.15.6:0/2091933486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f16dc057690 con 0x7f16f40ba550 2023-12-19T13:33:27.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:27.708 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f16d406a430 msgr2=0x7f16d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f16d406a430 0x7f16d406c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009990 tx=0x7f16ec008040 comp rx=0 tx=0).stop 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 msgr2=0x7f16f41e3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f41e3450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00d830 tx=0x7f16dc00dcf0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 shutdown_connections 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f16d406a430 0x7f16d406c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16f414b1f0 0x7f16f4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f40ba550 0x7f16f41e3450 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 --2- 172.21.15.6:0/2091933486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16f406a6d0 0x7f16f40a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.707+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 >> 172.21.15.6:0/2091933486 conn(0x7f16f40c0350 msgr2=0x7f16f414a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.708+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 shutdown_connections 2023-12-19T13:33:27.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.708+0000 7f16f8f00640 1 -- 172.21.15.6:0/2091933486 wait complete. 2023-12-19T13:33:27.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:27.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.827+0000 7efd460db640 1 Processor -- start 2023-12-19T13:33:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.827+0000 7efd460db640 1 -- start start 2023-12-19T13:33:27.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd460db640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 0x7efd400bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd460db640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 0x7efd401552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd460db640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400b83d0 con 0x7efd400b8b40 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd460db640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd40141900 con 0x7efd400b7740 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd460db640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400b86b0 con 0x7efd40141520 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 0x7efd400bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 0x7efd401552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 0x7efd400bc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:49806/0 (socket says 172.21.15.6:49806) 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 0x7efd401552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:55598/0 (socket says 172.21.15.6:55598) 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 -- 172.21.15.6:0/581008373 learned_addr learned my addr 172.21.15.6:0/581008373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 -- 172.21.15.6:0/581008373 >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 msgr2=0x7efd401552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 --2- 172.21.15.6:0/581008373 >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 0x7efd401552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 -- 172.21.15.6:0/581008373 >> v1:172.21.15.89:6789/0 conn(0x7efd400b8b40 legacy=0x7efd4014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3f7fe640 1 -- 172.21.15.6:0/581008373 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400bc0c0 con 0x7efd40141520 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3ffff640 1 --2- 172.21.15.6:0/581008373 >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 0x7efd401552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.828+0000 7efd3e7fc640 1 -- 172.21.15.6:0/581008373 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444671289 0 0) 0x7efd400b83d0 con 0x7efd400b8b40 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.829+0000 7efd3f7fe640 1 --2- 172.21.15.6:0/581008373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 0x7efd400bc520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd34009870 tx=0x7efd3402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0c2edb9781e715 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.829+0000 7efd3e7fc640 1 -- 172.21.15.6:0/581008373 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34031640 con 0x7efd40141520 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.829+0000 7efd3e7fc640 1 -- 172.21.15.6:0/581008373 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd340317a0 con 0x7efd40141520 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.829+0000 7efd3e7fc640 1 -- 172.21.15.6:0/581008373 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34031b30 con 0x7efd40141520 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 -- 172.21.15.6:0/581008373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 msgr2=0x7efd400bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 --2- 172.21.15.6:0/581008373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 0x7efd400bc520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd34009870 tx=0x7efd3402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 -- 172.21.15.6:0/581008373 shutdown_connections 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 --2- 172.21.15.6:0/581008373 >> v2:172.21.15.89:3300/0 conn(0x7efd400b7740 0x7efd401552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 --2- 172.21.15.6:0/581008373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd40141520 0x7efd400bc520 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 -- 172.21.15.6:0/581008373 >> 172.21.15.6:0/581008373 conn(0x7efd400c0300 msgr2=0x7efd400c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 -- 172.21.15.6:0/581008373 shutdown_connections 2023-12-19T13:33:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.830+0000 7efd460db640 1 -- 172.21.15.6:0/581008373 wait complete. 2023-12-19T13:33:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.831+0000 7efd460db640 1 Processor -- start 2023-12-19T13:33:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.831+0000 7efd460db640 1 -- start start 2023-12-19T13:33:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.831+0000 7efd460db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd400b7740 0x7efd40149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.831+0000 7efd460db640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd400b8b40 0x7efd40147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.831+0000 7efd460db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 0x7efd40148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd460db640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401463b0 con 0x7efd40141520 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd460db640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4014a420 con 0x7efd400b7740 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd460db640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd401461c0 con 0x7efd400b8b40 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 0x7efd40148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 0x7efd40148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44718/0 (socket says 172.21.15.6:44718) 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3effd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd400b8b40 0x7efd40147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd400b7740 0x7efd40149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 -- 172.21.15.6:0/692829388 learned_addr learned my addr 172.21.15.6:0/692829388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 -- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd400b8b40 msgr2=0x7efd40147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd400b8b40 0x7efd40147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 -- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd400b7740 msgr2=0x7efd40149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd400b7740 0x7efd40149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 -- 172.21.15.6:0/692829388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38009a70 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd3ffff640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 0x7efd40148030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd38009f00 tx=0x7efd3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38009d70 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800f040 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd340094d0 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38003bb0 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.832+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd40147080 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.833+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd401477f0 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.834+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd38014480 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.834+0000 7efd27fff640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7efd2c06a460 0x7efd2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.834+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd38089450 con 0x7efd40141520 2023-12-19T13:33:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.834+0000 7efd3f7fe640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7efd2c06a460 0x7efd2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.835+0000 7efd3f7fe640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7efd2c06a460 0x7efd2c06c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd34036000 tx=0x7efd3403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:27.838+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd38054a70 con 0x7efd40141520 2023-12-19T13:33:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.012+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd40073a40 con 0x7efd40141520 2023-12-19T13:33:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.012+0000 7efd27fff640 1 -- 172.21.15.6:0/692829388 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd38058090 con 0x7efd40141520 2023-12-19T13:33:28.014 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7efd2c06a460 msgr2=0x7efd2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7efd2c06a460 0x7efd2c06c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd34036000 tx=0x7efd3403c040 comp rx=0 tx=0).stop 2023-12-19T13:33:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 msgr2=0x7efd40148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 0x7efd40148030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd38009f00 tx=0x7efd3800c490 comp rx=0 tx=0).stop 2023-12-19T13:33:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 shutdown_connections 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7efd2c06a460 0x7efd2c06c920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40141520 0x7efd40148030 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd400b8b40 0x7efd40147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 --2- 172.21.15.6:0/692829388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd400b7740 0x7efd40149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 >> 172.21.15.6:0/692829388 conn(0x7efd400c0300 msgr2=0x7efd400ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 shutdown_connections 2023-12-19T13:33:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.014+0000 7efd460db640 1 -- 172.21.15.6:0/692829388 wait complete. 2023-12-19T13:33:28.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:28.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.133+0000 7f5bab4b6640 1 Processor -- start 2023-12-19T13:33:28.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.133+0000 7f5bab4b6640 1 -- start start 2023-12-19T13:33:28.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5bab4b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ba40b8690 0x7f5ba40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5bab4b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba40b77d0 0x7f5ba4144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5bab4b6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ba4144bb0 0x7f5ba414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5bab4b6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba414ab10 con 0x7f5ba4144bb0 2023-12-19T13:33:28.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5bab4b6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba406c2f0 con 0x7f5ba40b8690 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5bab4b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40ba620 con 0x7f5ba40b77d0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ba4144bb0 0x7f5ba414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ba4144bb0 0x7f5ba414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44732/0 (socket says 172.21.15.6:44732) 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 -- 172.21.15.6:0/375441067 learned_addr learned my addr 172.21.15.6:0/375441067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9252640 1 --2- 172.21.15.6:0/375441067 >> v2:172.21.15.89:3300/0 conn(0x7f5ba40b8690 0x7f5ba40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba8a51640 1 --2- 172.21.15.6:0/375441067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba40b77d0 0x7f5ba4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 -- 172.21.15.6:0/375441067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba40b77d0 msgr2=0x7f5ba4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 --2- 172.21.15.6:0/375441067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba40b77d0 0x7f5ba4144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 -- 172.21.15.6:0/375441067 >> v2:172.21.15.89:3300/0 conn(0x7f5ba40b8690 msgr2=0x7f5ba40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 --2- 172.21.15.6:0/375441067 >> v2:172.21.15.89:3300/0 conn(0x7f5ba40b8690 0x7f5ba40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.134+0000 7f5ba9a53640 1 -- 172.21.15.6:0/375441067 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40b9e60 con 0x7f5ba4144bb0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.135+0000 7f5ba9a53640 1 --2- 172.21.15.6:0/375441067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba4144bb0 0x7f5ba414afa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ba406aca0 tx=0x7f5ba002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1420f7cab07c15 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.135+0000 7f5b9bfff640 1 -- 172.21.15.6:0/375441067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba002c9e0 con 0x7f5ba4144bb0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.135+0000 7f5b9bfff640 1 -- 172.21.15.6:0/375441067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba002cb40 con 0x7f5ba4144bb0 2023-12-19T13:33:28.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.135+0000 7f5b9bfff640 1 -- 172.21.15.6:0/375441067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00343f0 con 0x7f5ba4144bb0 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 -- 172.21.15.6:0/375441067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba4144bb0 msgr2=0x7f5ba414afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/375441067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba4144bb0 0x7f5ba414afa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ba406aca0 tx=0x7f5ba002be40 comp rx=0 tx=0).stop 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 -- 172.21.15.6:0/375441067 shutdown_connections 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/375441067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba4144bb0 0x7f5ba414afa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/375441067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba40b77d0 0x7f5ba4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/375441067 >> v2:172.21.15.89:3300/0 conn(0x7f5ba40b8690 0x7f5ba40b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 -- 172.21.15.6:0/375441067 >> 172.21.15.6:0/375441067 conn(0x7f5ba406b6a0 msgr2=0x7f5ba406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 -- 172.21.15.6:0/375441067 shutdown_connections 2023-12-19T13:33:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.136+0000 7f5bab4b6640 1 -- 172.21.15.6:0/375441067 wait complete. 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.137+0000 7f5bab4b6640 1 Processor -- start 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.137+0000 7f5bab4b6640 1 -- start start 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b77d0 0x7f5ba414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 0x7f5ba41488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba4144bb0 0x7f5ba41491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba414a8a0 con 0x7f5ba40b8690 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41d7af0 con 0x7f5ba40b77d0 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4148e30 con 0x7f5ba4144bb0 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 0x7f5ba41488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 0x7f5ba41488f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44740/0 (socket says 172.21.15.6:44740) 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 -- 172.21.15.6:0/3425954025 learned_addr learned my addr 172.21.15.6:0/3425954025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba9a53640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba4144bb0 0x7f5ba41491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba9252640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b77d0 0x7f5ba414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 -- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba4144bb0 msgr2=0x7f5ba41491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba4144bb0 0x7f5ba41491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 -- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b77d0 msgr2=0x7f5ba414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b77d0 0x7f5ba414a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 -- 172.21.15.6:0/3425954025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009b30 con 0x7f5ba40b8690 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5ba8a51640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 0x7f5ba41488f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d830 tx=0x7f5b9400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940096a0 con 0x7f5ba40b8690 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94009800 con 0x7f5ba40b8690 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba41d1bf0 con 0x7f5ba40b8690 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.138+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94009b90 con 0x7f5ba40b8690 2023-12-19T13:33:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.139+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba41e0070 con 0x7f5ba40b8690 2023-12-19T13:33:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.140+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba41e0200 con 0x7f5ba40b8690 2023-12-19T13:33:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.140+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b94014410 con 0x7f5ba40b8690 2023-12-19T13:33:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.140+0000 7f5b99ffb640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b8806a430 0x7f5b8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.141+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b94088f20 con 0x7f5ba40b8690 2023-12-19T13:33:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.141+0000 7f5ba9252640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b8806a430 0x7f5b8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.141+0000 7f5ba9252640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b8806a430 0x7f5b8806c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006fd0 tx=0x7f5b9c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.145+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b94054490 con 0x7f5ba40b8690 2023-12-19T13:33:28.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.319+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ba40bca00 con 0x7f5ba40b8690 2023-12-19T13:33:28.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.319+0000 7f5b99ffb640 1 -- 172.21.15.6:0/3425954025 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b9400b440 con 0x7f5ba40b8690 2023-12-19T13:33:28.322 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.321+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b8806a430 msgr2=0x7f5b8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.321+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b8806a430 0x7f5b8806c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006fd0 tx=0x7f5b9c008040 comp rx=0 tx=0).stop 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.321+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 msgr2=0x7f5ba41488f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.321+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 0x7f5ba41488f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d830 tx=0x7f5b9400dcf0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 shutdown_connections 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b8806a430 0x7f5b8806c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba4144bb0 0x7f5ba41491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba40b8690 0x7f5ba41488f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 --2- 172.21.15.6:0/3425954025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b77d0 0x7f5ba414a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 >> 172.21.15.6:0/3425954025 conn(0x7f5ba406b6a0 msgr2=0x7f5ba40b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 shutdown_connections 2023-12-19T13:33:28.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.322+0000 7f5bab4b6640 1 -- 172.21.15.6:0/3425954025 wait complete. 2023-12-19T13:33:28.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.441+0000 7fcbaefd0640 1 Processor -- start 2023-12-19T13:33:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.441+0000 7fcbaefd0640 1 -- start start 2023-12-19T13:33:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbaefd0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba80b8690 0x7fcba80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbaefd0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcba8144d80 0x7fcba814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbaefd0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba814ab10 con 0x7fcba80b77d0 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbaefd0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba806c2f0 con 0x7fcba8144d80 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbaefd0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80ba620 con 0x7fcba80b8690 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbad56d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcba8144d80 0x7fcba814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcba7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcba80b77d0 0x7fcba8144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58658/0 (socket says 172.21.15.6:58658) 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcba7fff640 1 -- 172.21.15.6:0/2493793185 learned_addr learned my addr 172.21.15.6:0/2493793185 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbacd6c640 1 --2- 172.21.15.6:0/2493793185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba80b8690 0x7fcba80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbad56d640 1 -- 172.21.15.6:0/2493793185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba80b8690 msgr2=0x7fcba80b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbad56d640 1 --2- 172.21.15.6:0/2493793185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba80b8690 0x7fcba80b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbad56d640 1 -- 172.21.15.6:0/2493793185 >> v1:172.21.15.6:6789/0 conn(0x7fcba80b77d0 legacy=0x7fcba8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcbad56d640 1 -- 172.21.15.6:0/2493793185 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80b9e60 con 0x7fcba8144d80 2023-12-19T13:33:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.442+0000 7fcba77fe640 1 -- 172.21.15.6:0/2493793185 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695981682 0 0) 0x7fcba814ab10 con 0x7fcba80b77d0 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.443+0000 7fcbad56d640 1 --2- 172.21.15.6:0/2493793185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba8144d80 0x7fcba814afa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb980097a0 tx=0x7fcb9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8497ae8df26932b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.443+0000 7fcba77fe640 1 -- 172.21.15.6:0/2493793185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9802e070 con 0x7fcba8144d80 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.443+0000 7fcba77fe640 1 -- 172.21.15.6:0/2493793185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb980315a0 con 0x7fcba8144d80 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.443+0000 7fcba77fe640 1 -- 172.21.15.6:0/2493793185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98031930 con 0x7fcba8144d80 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 -- 172.21.15.6:0/2493793185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba8144d80 msgr2=0x7fcba814afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/2493793185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba8144d80 0x7fcba814afa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb980097a0 tx=0x7fcb9802b840 comp rx=0 tx=0).stop 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 -- 172.21.15.6:0/2493793185 shutdown_connections 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/2493793185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba8144d80 0x7fcba814afa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/2493793185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba80b8690 0x7fcba80b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 -- 172.21.15.6:0/2493793185 >> 172.21.15.6:0/2493793185 conn(0x7fcba806b6a0 msgr2=0x7fcba806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 -- 172.21.15.6:0/2493793185 shutdown_connections 2023-12-19T13:33:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.444+0000 7fcbaefd0640 1 -- 172.21.15.6:0/2493793185 wait complete. 2023-12-19T13:33:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.445+0000 7fcbaefd0640 1 Processor -- start 2023-12-19T13:33:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.445+0000 7fcbaefd0640 1 -- start start 2023-12-19T13:33:28.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 0x7fcba81df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcba80b8690 0x7fcba8149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba8144d80 0x7fcba8139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba81df9c0 con 0x7fcba80b77d0 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba81477e0 con 0x7fcba80b8690 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8147ac0 con 0x7fcba8144d80 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 0x7fcba81df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 0x7fcba81df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44754/0 (socket says 172.21.15.6:44754) 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 -- 172.21.15.6:0/3282412567 learned_addr learned my addr 172.21.15.6:0/3282412567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbad56d640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba8144d80 0x7fcba8139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcba7fff640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcba80b8690 0x7fcba8149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 -- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba8144d80 msgr2=0x7fcba8139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba8144d80 0x7fcba8139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 -- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcba80b8690 msgr2=0x7fcba8149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcba80b8690 0x7fcba8149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 -- 172.21.15.6:0/3282412567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98009400 con 0x7fcba80b77d0 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbad56d640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba8144d80 0x7fcba8139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:28.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcba7fff640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcba80b8690 0x7fcba8149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbacd6c640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 0x7fcba81df480 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcba000efc0 tx=0x7fcba000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0014480 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba000f040 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba8149f70 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.446+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0014800 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.447+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba813a6d0 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.447+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba81485b0 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.448+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcba0014960 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.448+0000 7fcba57fa640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcb9406a430 0x7fcb9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.448+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcba0089540 con 0x7fcba80b77d0 2023-12-19T13:33:28.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.448+0000 7fcba7fff640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcb9406a430 0x7fcb9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.449+0000 7fcba7fff640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcb9406a430 0x7fcb9406c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcba81424f0 tx=0x7fcb9c007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.452+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcba81485b0 con 0x7fcba80b77d0 2023-12-19T13:33:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.627+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcba81485b0 con 0x7fcba80b77d0 2023-12-19T13:33:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.628+0000 7fcba57fa640 1 -- 172.21.15.6:0/3282412567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcba81485b0 con 0x7fcba80b77d0 2023-12-19T13:33:28.630 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcb9406a430 msgr2=0x7fcb9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcb9406a430 0x7fcb9406c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcba81424f0 tx=0x7fcb9c007c10 comp rx=0 tx=0).stop 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 msgr2=0x7fcba81df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 0x7fcba81df480 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcba000efc0 tx=0x7fcba000c490 comp rx=0 tx=0).stop 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 shutdown_connections 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcb9406a430 0x7fcb9406c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcba8144d80 0x7fcba8139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcba80b8690 0x7fcba8149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 --2- 172.21.15.6:0/3282412567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba80b77d0 0x7fcba81df480 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 >> 172.21.15.6:0/3282412567 conn(0x7fcba806b6a0 msgr2=0x7fcba80ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 shutdown_connections 2023-12-19T13:33:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.630+0000 7fcbaefd0640 1 -- 172.21.15.6:0/3282412567 wait complete. 2023-12-19T13:33:28.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.746+0000 7fdbbf158640 1 Processor -- start 2023-12-19T13:33:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbf158640 1 -- start start 2023-12-19T13:33:28.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbf158640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb806af80 0x7fdbb80b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbf158640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbb80b8e60 0x7fdbb81415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbf158640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb8147b40 con 0x7fdbb8141b20 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbf158640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb8147e20 con 0x7fdbb806af80 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbf158640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb8148100 con 0x7fdbb80b8e60 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbcef4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb806af80 0x7fdbb80b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbcef4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb806af80 0x7fdbb80b8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44766/0 (socket says 172.21.15.6:44766) 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.747+0000 7fdbbcef4640 1 -- 172.21.15.6:0/2473985026 learned_addr learned my addr 172.21.15.6:0/2473985026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.748+0000 7fdbb7fff640 1 --2- 172.21.15.6:0/2473985026 >> v2:172.21.15.89:3300/0 conn(0x7fdbb80b8e60 0x7fdbb81415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.748+0000 7fdbbcef4640 1 -- 172.21.15.6:0/2473985026 >> v2:172.21.15.89:3300/0 conn(0x7fdbb80b8e60 msgr2=0x7fdbb81415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.748+0000 7fdbbcef4640 1 --2- 172.21.15.6:0/2473985026 >> v2:172.21.15.89:3300/0 conn(0x7fdbb80b8e60 0x7fdbb81415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.748+0000 7fdbbcef4640 1 -- 172.21.15.6:0/2473985026 >> v1:172.21.15.89:6789/0 conn(0x7fdbb8141b20 legacy=0x7fdbb806f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.748+0000 7fdbbcef4640 1 -- 172.21.15.6:0/2473985026 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb81483e0 con 0x7fdbb806af80 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.748+0000 7fdbbcef4640 1 --2- 172.21.15.6:0/2473985026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb806af80 0x7fdbb80b8920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80bc6e0 tx=0x7fdbac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d9a2b3fd2bd970 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbb77fe640 1 -- 172.21.15.6:0/2473985026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac030860 con 0x7fdbb806af80 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbb77fe640 1 -- 172.21.15.6:0/2473985026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0309c0 con 0x7fdbb806af80 2023-12-19T13:33:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbb77fe640 1 -- 172.21.15.6:0/2473985026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac030d50 con 0x7fdbb806af80 2023-12-19T13:33:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 -- 172.21.15.6:0/2473985026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb806af80 msgr2=0x7fdbb80b8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 --2- 172.21.15.6:0/2473985026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb806af80 0x7fdbb80b8920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80bc6e0 tx=0x7fdbac02b9a0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 -- 172.21.15.6:0/2473985026 shutdown_connections 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 --2- 172.21.15.6:0/2473985026 >> v2:172.21.15.89:3300/0 conn(0x7fdbb80b8e60 0x7fdbb81415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 --2- 172.21.15.6:0/2473985026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb806af80 0x7fdbb80b8920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 -- 172.21.15.6:0/2473985026 >> 172.21.15.6:0/2473985026 conn(0x7fdbb80b9250 msgr2=0x7fdbb80b9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 -- 172.21.15.6:0/2473985026 shutdown_connections 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.749+0000 7fdbbf158640 1 -- 172.21.15.6:0/2473985026 wait complete. 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.750+0000 7fdbbf158640 1 Processor -- start 2023-12-19T13:33:28.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.750+0000 7fdbbf158640 1 -- start start 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbf158640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb806af80 0x7fdbb80b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbf158640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb8141b20 0x7fdbb81e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbf158640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 0x7fdbb81d3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbf158640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80b7900 con 0x7fdbb8142c00 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbf158640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8144d30 con 0x7fdbb806af80 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbf158640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8142770 con 0x7fdbb8141b20 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 0x7fdbb81d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 0x7fdbb81d3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44778/0 (socket says 172.21.15.6:44778) 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 -- 172.21.15.6:0/3027096590 learned_addr learned my addr 172.21.15.6:0/3027096590 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbcef4640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb806af80 0x7fdbb80b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbb7fff640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb8141b20 0x7fdbb81e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 -- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb8141b20 msgr2=0x7fdbb81e2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb8141b20 0x7fdbb81e2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 -- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb806af80 msgr2=0x7fdbb80b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb806af80 0x7fdbb80b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.751+0000 7fdbbd6f5640 1 -- 172.21.15.6:0/3027096590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0094d0 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.752+0000 7fdbbd6f5640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 0x7fdbb81d3370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000b970 tx=0x7fdbb000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.752+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000cb40 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.752+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000cca0 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.752+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb8144a50 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.752+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0014680 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.752+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81e3280 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.753+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8073a40 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.753+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdbb001d3b0 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.754+0000 7fdbb57fa640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdb9c06a430 0x7fdb9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.754+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbb0088560 con 0x7fdbb8142c00 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.754+0000 7fdbbcef4640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdb9c06a430 0x7fdb9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:28.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.754+0000 7fdbbcef4640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdb9c06a430 0x7fdb9c06c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdbac036000 tx=0x7fdbac008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.758+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdbb0053c90 con 0x7fdbb8142c00 2023-12-19T13:33:28.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.937+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbb81428b0 con 0x7fdbb8142c00 2023-12-19T13:33:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.938+0000 7fdbb57fa640 1 -- 172.21.15.6:0/3027096590 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7fdbb00572b0 con 0x7fdbb8142c00 2023-12-19T13:33:28.940 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:28.940 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdb9c06a430 msgr2=0x7fdb9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdb9c06a430 0x7fdb9c06c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdbac036000 tx=0x7fdbac008030 comp rx=0 tx=0).stop 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 msgr2=0x7fdbb81d3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 0x7fdbb81d3370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000b970 tx=0x7fdbb000be30 comp rx=0 tx=0).stop 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 shutdown_connections 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdb9c06a430 0x7fdb9c06c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8142c00 0x7fdbb81d3370 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb8141b20 0x7fdbb81e2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 --2- 172.21.15.6:0/3027096590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb806af80 0x7fdbb80b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 >> 172.21.15.6:0/3027096590 conn(0x7fdbb80b9250 msgr2=0x7fdbb8145700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:28.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 shutdown_connections 2023-12-19T13:33:28.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:28.940+0000 7fdbbf158640 1 -- 172.21.15.6:0/3027096590 wait complete. 2023-12-19T13:33:28.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:28.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.060+0000 7f47f031b640 1 Processor -- start 2023-12-19T13:33:29.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.060+0000 7f47f031b640 1 -- start start 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47f031b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e8142f20 0x7f47e80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47f031b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47e80a0cc0 0x7f47e80b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47f031b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e81498f0 con 0x7f47e80b47d0 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47f031b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80b37e0 con 0x7f47e8142f20 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47f031b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e8148fc0 con 0x7f47e80a0cc0 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e8142f20 0x7f47e80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e8142f20 0x7f47e80b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44788/0 (socket says 172.21.15.6:44788) 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 -- 172.21.15.6:0/4029015513 learned_addr learned my addr 172.21.15.6:0/4029015513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 -- 172.21.15.6:0/4029015513 >> v2:172.21.15.89:3300/0 conn(0x7f47e80a0cc0 msgr2=0x7f47e80b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 --2- 172.21.15.6:0/4029015513 >> v2:172.21.15.89:3300/0 conn(0x7f47e80a0cc0 0x7f47e80b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 -- 172.21.15.6:0/4029015513 >> v1:172.21.15.89:6789/0 conn(0x7f47e80b47d0 legacy=0x7f47e814bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.061+0000 7f47ee0b7640 1 -- 172.21.15.6:0/4029015513 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e81492a0 con 0x7f47e8142f20 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.062+0000 7f47ee0b7640 1 --2- 172.21.15.6:0/4029015513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e8142f20 0x7f47e80b4290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f47e8066640 tx=0x7f47e002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215dd477a8d93691 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.062+0000 7f47ed0b5640 1 -- 172.21.15.6:0/4029015513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e002cb20 con 0x7f47e8142f20 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.062+0000 7f47ed0b5640 1 -- 172.21.15.6:0/4029015513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e002cc80 con 0x7f47e8142f20 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.062+0000 7f47ed0b5640 1 -- 172.21.15.6:0/4029015513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e00343f0 con 0x7f47e8142f20 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 -- 172.21.15.6:0/4029015513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e8142f20 msgr2=0x7f47e80b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 --2- 172.21.15.6:0/4029015513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e8142f20 0x7f47e80b4290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f47e8066640 tx=0x7f47e002bf80 comp rx=0 tx=0).stop 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 -- 172.21.15.6:0/4029015513 shutdown_connections 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 --2- 172.21.15.6:0/4029015513 >> v2:172.21.15.89:3300/0 conn(0x7f47e80a0cc0 0x7f47e80b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 --2- 172.21.15.6:0/4029015513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e8142f20 0x7f47e80b4290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 -- 172.21.15.6:0/4029015513 >> 172.21.15.6:0/4029015513 conn(0x7f47e80be1e0 msgr2=0x7f47e80be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 -- 172.21.15.6:0/4029015513 shutdown_connections 2023-12-19T13:33:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.063+0000 7f47f031b640 1 -- 172.21.15.6:0/4029015513 wait complete. 2023-12-19T13:33:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.064+0000 7f47f031b640 1 Processor -- start 2023-12-19T13:33:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.064+0000 7f47f031b640 1 -- start start 2023-12-19T13:33:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.064+0000 7f47f031b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 0x7f47e806c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.064+0000 7f47f031b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47e80b47d0 0x7f47e806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.064+0000 7f47f031b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e8142f20 0x7f47e80bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47f031b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e806cd80 con 0x7f47e80a0cc0 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47f031b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80bc4a0 con 0x7f47e8142f20 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47f031b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e806afa0 con 0x7f47e80b47d0 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 0x7f47e806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 0x7f47e806c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44790/0 (socket says 172.21.15.6:44790) 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 -- 172.21.15.6:0/3306941920 learned_addr learned my addr 172.21.15.6:0/3306941920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 -- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47e80b47d0 msgr2=0x7f47e806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47e80b47d0 0x7f47e806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 -- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e8142f20 msgr2=0x7f47e80bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee8b8640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e8142f20 0x7f47e80bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e8142f20 0x7f47e80bd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 -- 172.21.15.6:0/3306941920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0009b30 con 0x7f47e80a0cc0 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47ee0b7640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 0x7f47e806c840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47e00093e0 tx=0x7f47e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0007e90 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0009510 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e806c1d0 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e003e690 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.065+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e806b770 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.066+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8066e90 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.067+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47e003e7f0 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.067+0000 7f47deffd640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f47cc06a430 0x7f47cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.067+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47e00ab600 con 0x7f47e80a0cc0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.067+0000 7f47ed8b6640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f47cc06a430 0x7f47cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.068+0000 7f47ed8b6640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f47cc06a430 0x7f47cc06c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e80b9b30 tx=0x7f47d8006c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.071+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47e0076d40 con 0x7f47e80a0cc0 2023-12-19T13:33:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.246+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47e806b960 con 0x7f47e80a0cc0 2023-12-19T13:33:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.247+0000 7f47deffd640 1 -- 172.21.15.6:0/3306941920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47e007a360 con 0x7f47e80a0cc0 2023-12-19T13:33:29.249 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.248+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f47cc06a430 msgr2=0x7f47cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f47cc06a430 0x7f47cc06c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e80b9b30 tx=0x7f47d8006c90 comp rx=0 tx=0).stop 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 msgr2=0x7f47e806c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 0x7f47e806c840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47e00093e0 tx=0x7f47e0004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 shutdown_connections 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f47cc06a430 0x7f47cc06c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e8142f20 0x7f47e80bd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47e80b47d0 0x7f47e806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 --2- 172.21.15.6:0/3306941920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e80a0cc0 0x7f47e806c840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 >> 172.21.15.6:0/3306941920 conn(0x7f47e80be1e0 msgr2=0x7f47e813b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 shutdown_connections 2023-12-19T13:33:29.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.249+0000 7f47f031b640 1 -- 172.21.15.6:0/3306941920 wait complete. 2023-12-19T13:33:29.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 Processor -- start 2023-12-19T13:33:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 -- start start 2023-12-19T13:33:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e00b8690 0x7f43e00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43e00b77d0 0x7f43e0144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e014ab10 con 0x7f43e0144bb0 2023-12-19T13:33:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e006c2f0 con 0x7f43e00b77d0 2023-12-19T13:33:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43e543e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00ba620 con 0x7f43e00b8690 2023-12-19T13:33:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.368+0000 7f43d67fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43e00b77d0 0x7f43e0144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43df7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f43e0144bb0 0x7f43e014afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58668/0 (socket says 172.21.15.6:58668) 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43d67fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43e00b77d0 0x7f43e0144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44792/0 (socket says 172.21.15.6:44792) 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43df7fe640 1 -- 172.21.15.6:0/3061523714 learned_addr learned my addr 172.21.15.6:0/3061523714 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43deffd640 1 --2- 172.21.15.6:0/3061523714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e00b8690 0x7f43e00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43d67fc640 1 -- 172.21.15.6:0/3061523714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e00b8690 msgr2=0x7f43e00b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43d67fc640 1 --2- 172.21.15.6:0/3061523714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e00b8690 0x7f43e00b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43d67fc640 1 -- 172.21.15.6:0/3061523714 >> v1:172.21.15.6:6789/0 conn(0x7f43e0144bb0 legacy=0x7f43e014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43de7fc640 1 -- 172.21.15.6:0/3061523714 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044658113 0 0) 0x7f43e014ab10 con 0x7f43e0144bb0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.369+0000 7f43d67fc640 1 -- 172.21.15.6:0/3061523714 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00b9e60 con 0x7f43e00b77d0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43d67fc640 1 --2- 172.21.15.6:0/3061523714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e0144670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097a0 tx=0x7f43c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7801790b7191e65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43de7fc640 1 -- 172.21.15.6:0/3061523714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c802e070 con 0x7f43e00b77d0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43de7fc640 1 -- 172.21.15.6:0/3061523714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80315a0 con 0x7f43e00b77d0 2023-12-19T13:33:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43de7fc640 1 -- 172.21.15.6:0/3061523714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8031930 con 0x7f43e00b77d0 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 -- 172.21.15.6:0/3061523714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 msgr2=0x7f43e0144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 --2- 172.21.15.6:0/3061523714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e0144670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097a0 tx=0x7f43c802b840 comp rx=0 tx=0).stop 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 -- 172.21.15.6:0/3061523714 shutdown_connections 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 --2- 172.21.15.6:0/3061523714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e0144670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 --2- 172.21.15.6:0/3061523714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e00b8690 0x7f43e00b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 -- 172.21.15.6:0/3061523714 >> 172.21.15.6:0/3061523714 conn(0x7f43e006b6a0 msgr2=0x7f43e006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 -- 172.21.15.6:0/3061523714 shutdown_connections 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.370+0000 7f43e543e640 1 -- 172.21.15.6:0/3061523714 wait complete. 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 Processor -- start 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 -- start start 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e01d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00b8690 0x7f43e0149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0144bb0 0x7f43e0146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e0148780 con 0x7f43e00b77d0 2023-12-19T13:33:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e014a110 con 0x7f43e00b8690 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43e543e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e01d7a20 con 0x7f43e0144bb0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43deffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e01d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43deffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e01d19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44802/0 (socket says 172.21.15.6:44802) 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.372+0000 7f43deffd640 1 -- 172.21.15.6:0/649148821 learned_addr learned my addr 172.21.15.6:0/649148821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43d67fc640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00b8690 0x7f43e0149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43df7fe640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0144bb0 0x7f43e0146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43deffd640 1 -- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0144bb0 msgr2=0x7f43e0146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43deffd640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0144bb0 0x7f43e0146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43deffd640 1 -- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00b8690 msgr2=0x7f43e0149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43deffd640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00b8690 0x7f43e0149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43deffd640 1 -- 172.21.15.6:0/649148821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009400 con 0x7f43e00b77d0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43deffd640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e01d19b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43d000e9b0 tx=0x7f43d000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0009670 con 0x7f43e00b77d0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d000c9a0 con 0x7f43e00b77d0 2023-12-19T13:33:29.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d000cd50 con 0x7f43e00b77d0 2023-12-19T13:33:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e0148230 con 0x7f43e00b77d0 2023-12-19T13:33:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.373+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e01d7500 con 0x7f43e00b77d0 2023-12-19T13:33:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.374+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e0073a40 con 0x7f43e00b77d0 2023-12-19T13:33:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.374+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43d0013470 con 0x7f43e00b77d0 2023-12-19T13:33:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.375+0000 7f43d7fff640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43c006a430 0x7f43c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.375+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43d0088bb0 con 0x7f43e00b77d0 2023-12-19T13:33:29.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.375+0000 7f43d67fc640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43c006a430 0x7f43c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.376+0000 7f43d67fc640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43c006a430 0x7f43c006c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43c8036000 tx=0x7f43c8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.379+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43d0054190 con 0x7f43e00b77d0 2023-12-19T13:33:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.553+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43e013d590 con 0x7f43e00b77d0 2023-12-19T13:33:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.554+0000 7f43d7fff640 1 -- 172.21.15.6:0/649148821 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43d0017020 con 0x7f43e00b77d0 2023-12-19T13:33:29.556 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43c006a430 msgr2=0x7f43c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43c006a430 0x7f43c006c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43c8036000 tx=0x7f43c8008030 comp rx=0 tx=0).stop 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 msgr2=0x7f43e01d19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e01d19b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43d000e9b0 tx=0x7f43d000ee70 comp rx=0 tx=0).stop 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 shutdown_connections 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43c006a430 0x7f43c006c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e0144bb0 0x7f43e0146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e00b8690 0x7f43e0149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 --2- 172.21.15.6:0/649148821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00b77d0 0x7f43e01d19b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 >> 172.21.15.6:0/649148821 conn(0x7f43e006b6a0 msgr2=0x7f43e0141ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 shutdown_connections 2023-12-19T13:33:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.556+0000 7f43e543e640 1 -- 172.21.15.6:0/649148821 wait complete. 2023-12-19T13:33:29.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.676+0000 7f6aeeb1b640 1 Processor -- start 2023-12-19T13:33:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.676+0000 7f6aeeb1b640 1 -- start start 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aeeb1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ae80bc930 0x7f6ae80bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aeeb1b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae806b650 con 0x7f6ae80bb150 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aeeb1b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae806bae0 con 0x7f6ae80bdca0 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aeeb1b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae806adf0 con 0x7f6ae80bc930 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aed0b8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ae80bc930 0x7f6ae80bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aec8b7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ae80bb150 0x7f6ae80b4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58684/0 (socket says 172.21.15.6:58684) 2023-12-19T13:33:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aec8b7640 1 -- 172.21.15.6:0/3525634439 learned_addr learned my addr 172.21.15.6:0/3525634439 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aed0b8640 1 -- 172.21.15.6:0/3525634439 >> v1:172.21.15.89:6789/0 conn(0x7f6ae80bdca0 legacy=0x7f6ae81449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aed0b8640 1 -- 172.21.15.6:0/3525634439 >> v1:172.21.15.6:6789/0 conn(0x7f6ae80bb150 legacy=0x7f6ae80b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6aed0b8640 1 -- 172.21.15.6:0/3525634439 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae806b000 con 0x7f6ae80bc930 2023-12-19T13:33:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.677+0000 7f6ae77fe640 1 -- 172.21.15.6:0/3525634439 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105725745 0 0) 0x7f6ae806b650 con 0x7f6ae80bb150 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.678+0000 7f6aed0b8640 1 --2- 172.21.15.6:0/3525634439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae80bcd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009d90 tx=0x7f6ae002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4db47e25d56667 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.678+0000 7f6ae77fe640 1 -- 172.21.15.6:0/3525634439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae002cc60 con 0x7f6ae80bc930 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.678+0000 7f6ae77fe640 1 -- 172.21.15.6:0/3525634439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae002cdc0 con 0x7f6ae80bc930 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.678+0000 7f6ae77fe640 1 -- 172.21.15.6:0/3525634439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0034660 con 0x7f6ae80bc930 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.678+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/3525634439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 msgr2=0x7f6ae80bcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.678+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/3525634439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae80bcd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009d90 tx=0x7f6ae002beb0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.679+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/3525634439 shutdown_connections 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.679+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/3525634439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae80bcd80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.679+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/3525634439 >> 172.21.15.6:0/3525634439 conn(0x7f6ae8069ee0 msgr2=0x7f6ae806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.679+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/3525634439 shutdown_connections 2023-12-19T13:33:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.679+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/3525634439 wait complete. 2023-12-19T13:33:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 Processor -- start 2023-12-19T13:33:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 -- start start 2023-12-19T13:33:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae80bb150 0x7f6ae81e0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae8148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae80bdca0 0x7f6ae80b9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81dfc50 con 0x7f6ae80bc930 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80ba9e0 con 0x7f6ae80bb150 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6aeeb1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81dfef0 con 0x7f6ae80bdca0 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae8148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae8148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44814/0 (socket says 172.21.15.6:44814) 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.680+0000 7f6ae7fff640 1 -- 172.21.15.6:0/2004166967 learned_addr learned my addr 172.21.15.6:0/2004166967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6aec8b7640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae80bb150 0x7f6ae81e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6aed0b8640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae80bdca0 0x7f6ae80b9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae7fff640 1 -- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae80bdca0 msgr2=0x7f6ae80b9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae7fff640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae80bdca0 0x7f6ae80b9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae7fff640 1 -- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae80bb150 msgr2=0x7f6ae81e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae7fff640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae80bb150 0x7f6ae81e0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae7fff640 1 -- 172.21.15.6:0/2004166967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009a70 con 0x7f6ae80bc930 2023-12-19T13:33:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6aed0b8640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae80bdca0 0x7f6ae80b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae7fff640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae8148cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c3f0 tx=0x7f6ad400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40052d0 con 0x7f6ae80bc930 2023-12-19T13:33:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4005450 con 0x7f6ae80bc930 2023-12-19T13:33:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae80b94d0 con 0x7f6ae80bc930 2023-12-19T13:33:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4003830 con 0x7f6ae80bc930 2023-12-19T13:33:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.681+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae81e3e60 con 0x7f6ae80bc930 2023-12-19T13:33:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.682+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae81e0060 con 0x7f6ae80bc930 2023-12-19T13:33:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.682+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ad4003990 con 0x7f6ae80bc930 2023-12-19T13:33:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.683+0000 7f6ae57fa640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6acc06a460 0x7f6acc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.683+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ad4087d50 con 0x7f6ae80bc930 2023-12-19T13:33:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.683+0000 7f6aec8b7640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6acc06a460 0x7f6acc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.683+0000 7f6aec8b7640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6acc06a460 0x7f6acc06c920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6adc007f70 tx=0x7f6adc007f00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.687+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ad408b030 con 0x7f6ae80bc930 2023-12-19T13:33:29.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.862+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ae8073a40 con 0x7f6ae80bc930 2023-12-19T13:33:29.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.863+0000 7f6ae57fa640 1 -- 172.21.15.6:0/2004166967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ad4053480 con 0x7f6ae80bc930 2023-12-19T13:33:29.865 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6acc06a460 msgr2=0x7f6acc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6acc06a460 0x7f6acc06c920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6adc007f70 tx=0x7f6adc007f00 comp rx=0 tx=0).stop 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 msgr2=0x7f6ae8148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae8148cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c3f0 tx=0x7f6ad400c8b0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 shutdown_connections 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6acc06a460 0x7f6acc06c920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae80bdca0 0x7f6ae80b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae80bc930 0x7f6ae8148cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 --2- 172.21.15.6:0/2004166967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae80bb150 0x7f6ae81e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.864+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 >> 172.21.15.6:0/2004166967 conn(0x7f6ae8069ee0 msgr2=0x7f6ae81447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.865+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 shutdown_connections 2023-12-19T13:33:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.865+0000 7f6aeeb1b640 1 -- 172.21.15.6:0/2004166967 wait complete. 2023-12-19T13:33:29.887 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T13:33:29.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:29.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.991+0000 7fae0331b640 1 Processor -- start 2023-12-19T13:33:29.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.991+0000 7fae0331b640 1 -- start start 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae0331b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fadfc0712a0 0x7fadfc1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae0331b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0b8550 con 0x7fadfc148ef0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae0331b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0b6120 con 0x7fadfc070ec0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae0331b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc0b7a70 con 0x7fadfc0712a0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae018b8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fadfc148ef0 0x7fadfc153310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58700/0 (socket says 172.21.15.6:58700) 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae018b8640 1 -- 172.21.15.6:0/2763408289 learned_addr learned my addr 172.21.15.6:0/2763408289 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fae008b6640 1 --2- 172.21.15.6:0/2763408289 >> v2:172.21.15.89:3300/0 conn(0x7fadfc0712a0 0x7fadfc1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720532454 0 0) 0x7fadfc0b8550 con 0x7fadfc148ef0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.992+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade4003520 con 0x7fadfc148ef0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560496568 0 0) 0x7fadfc0b6120 con 0x7fadfc070ec0 2023-12-19T13:33:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadfc0b8550 con 0x7fadfc070ec0 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423905044 0 0) 0x7fade4003520 con 0x7fadfc148ef0 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 >> v2:172.21.15.89:3300/0 conn(0x7fadfc0712a0 msgr2=0x7fadfc1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 --2- 172.21.15.6:0/2763408289 >> v2:172.21.15.89:3300/0 conn(0x7fadfc0712a0 0x7fadfc1489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 >> v1:172.21.15.89:6789/0 conn(0x7fadfc070ec0 legacy=0x7fadfc0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0b7d50 con 0x7fadfc148ef0 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fadec0019f0 con 0x7fadfc148ef0 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 --2- 172.21.15.6:0/2763408289 >> v2:172.21.15.89:3300/0 conn(0x7fadfc0712a0 0x7fadfc1489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 >> v1:172.21.15.6:6789/0 conn(0x7fadfc148ef0 legacy=0x7fadfc153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade4003b00 0x7fade4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade40047c0 0x7fade4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fade4005180 0x7fade400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0b7a70 con 0x7fade40047c0 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade400bf70 con 0x7fade4005180 2023-12-19T13:33:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade400c130 con 0x7fade4003b00 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade40047c0 0x7fade4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae018b8640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fade4005180 0x7fade400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae010b7640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade4003b00 0x7fade4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 -- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade4003b00 msgr2=0x7fade4003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade4003b00 0x7fade4003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 -- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fade4005180 msgr2=0x7fade400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fade4005180 0x7fade400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae008b6640 1 -- 172.21.15.6:0/2763408289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4003520 con 0x7fade40047c0 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.993+0000 7fae018b8640 1 -- 172.21.15.6:0/2763408289 reap_dead start 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.994+0000 7fae008b6640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade40047c0 0x7fade4004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009c60 tx=0x7fade40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95b2f47fd90f241 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.994+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf002c8d0 con 0x7fade40047c0 2023-12-19T13:33:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.994+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf002ca30 con 0x7fade40047c0 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.994+0000 7fadfbfff640 1 -- 172.21.15.6:0/2763408289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf002cde0 con 0x7fade40047c0 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.994+0000 7fae0331b640 1 -- 172.21.15.6:0/2763408289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade40047c0 msgr2=0x7fade4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.994+0000 7fae0331b640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade40047c0 0x7fade4004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009c60 tx=0x7fade40057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.995+0000 7fae0331b640 1 -- 172.21.15.6:0/2763408289 shutdown_connections 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.995+0000 7fae0331b640 1 --2- 172.21.15.6:0/2763408289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade40047c0 0x7fade4004c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.995+0000 7fae0331b640 1 -- 172.21.15.6:0/2763408289 >> 172.21.15.6:0/2763408289 conn(0x7fadfc0be150 msgr2=0x7fadfc0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.995+0000 7fae0331b640 1 -- 172.21.15.6:0/2763408289 shutdown_connections 2023-12-19T13:33:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.995+0000 7fae0331b640 1 -- 172.21.15.6:0/2763408289 wait complete. 2023-12-19T13:33:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 Processor -- start 2023-12-19T13:33:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 -- start start 2023-12-19T13:33:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade40047c0 0x7fadfc141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 0x7fadfc1395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadfc139af0 0x7fadfc1d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc140190 con 0x7fadfc140920 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc145db0 con 0x7fadfc139af0 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae0331b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc140da0 con 0x7fade40047c0 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.996+0000 7fae008b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 0x7fadfc1395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 0x7fadfc1395b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44822/0 (socket says 172.21.15.6:44822) 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 -- 172.21.15.6:0/2106489846 learned_addr learned my addr 172.21.15.6:0/2106489846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae010b7640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade40047c0 0x7fadfc141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae018b8640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadfc139af0 0x7fadfc1d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 -- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade40047c0 msgr2=0x7fadfc141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade40047c0 0x7fadfc141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 -- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadfc139af0 msgr2=0x7fadfc1d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadfc139af0 0x7fadfc1d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 -- 172.21.15.6:0/2106489846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0bde20 con 0x7fadfc140920 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae008b6640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 0x7fadfc1395b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fadf0037040 tx=0x7fadf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0034a80 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0034be0 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc141fb0 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0004020 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.997+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc13fe20 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.998+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc073a40 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.999+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fadf0004180 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.999+0000 7fadf9ffb640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fade806a430 0x7fade806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.999+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadf00aab90 con 0x7fadfc140920 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:29.999+0000 7fae010b7640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fade806a430 0x7fade806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.000+0000 7fae010b7640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fade806a430 0x7fade806c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadfc04f2f0 tx=0x7fadf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.003+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fadf0076210 con 0x7fadfc140920 2023-12-19T13:33:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.181+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadfc146d10 con 0x7fadfc140920 2023-12-19T13:33:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.182+0000 7fadf9ffb640 1 -- 172.21.15.6:0/2106489846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7fadf0079830 con 0x7fadfc140920 2023-12-19T13:33:30.184 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fade806a430 msgr2=0x7fade806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fade806a430 0x7fade806c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadfc04f2f0 tx=0x7fadf4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 msgr2=0x7fadfc1395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 0x7fadfc1395b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fadf0037040 tx=0x7fadf0004730 comp rx=0 tx=0).stop 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 shutdown_connections 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fade806a430 0x7fade806c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadfc139af0 0x7fadfc1d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc140920 0x7fadfc1395b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 --2- 172.21.15.6:0/2106489846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fade40047c0 0x7fadfc141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 >> 172.21.15.6:0/2106489846 conn(0x7fadfc0be150 msgr2=0x7fadfc13b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 shutdown_connections 2023-12-19T13:33:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.184+0000 7fae0331b640 1 -- 172.21.15.6:0/2106489846 wait complete. 2023-12-19T13:33:30.197 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:30.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.304+0000 7f06ea355640 1 Processor -- start 2023-12-19T13:33:30.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.304+0000 7f06ea355640 1 -- start start 2023-12-19T13:33:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06ea355640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e4144d80 0x7f06e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06ea355640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06e40b77d0 0x7f06e414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06ea355640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e414ab10 con 0x7f06e40b8690 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06ea355640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e406c2f0 con 0x7f06e40b77d0 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06ea355640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40ba620 con 0x7f06e4144d80 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06e37fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e4144d80 0x7f06e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06e88f2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06e40b77d0 0x7f06e414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06e88f2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06e40b77d0 0x7f06e414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:55712/0 (socket says 172.21.15.6:55712) 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06e3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f06e40b8690 0x7f06e4144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:38132/0 (socket says 172.21.15.6:38132) 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06e88f2640 1 -- 172.21.15.6:0/657829578 learned_addr learned my addr 172.21.15.6:0/657829578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.305+0000 7f06e37fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e4144d80 0x7f06e40b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:49938/0 (socket says 172.21.15.6:49938) 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e88f2640 1 -- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e4144d80 msgr2=0x7f06e40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e88f2640 1 --2- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e4144d80 0x7f06e40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e88f2640 1 -- 172.21.15.6:0/657829578 >> v1:172.21.15.89:6789/0 conn(0x7f06e40b8690 legacy=0x7f06e4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e88f2640 1 -- 172.21.15.6:0/657829578 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40b9e60 con 0x7f06e40b77d0 2023-12-19T13:33:30.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e2ffd640 1 -- 172.21.15.6:0/657829578 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195033722 0 0) 0x7f06e414ab10 con 0x7f06e40b8690 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e88f2640 1 --2- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e40b77d0 0x7f06e414afa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009e50 tx=0x7f06dc02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c89f8890a102c98c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.306+0000 7f06e2ffd640 1 -- 172.21.15.6:0/657829578 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc02ca70 con 0x7f06e40b77d0 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06e2ffd640 1 -- 172.21.15.6:0/657829578 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc02cbd0 con 0x7f06e40b77d0 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06e2ffd640 1 -- 172.21.15.6:0/657829578 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0343f0 con 0x7f06e40b77d0 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 -- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e40b77d0 msgr2=0x7f06e414afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 --2- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e40b77d0 0x7f06e414afa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009e50 tx=0x7f06dc02bed0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 -- 172.21.15.6:0/657829578 shutdown_connections 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 --2- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e40b77d0 0x7f06e414afa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 --2- 172.21.15.6:0/657829578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e4144d80 0x7f06e40b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 -- 172.21.15.6:0/657829578 >> 172.21.15.6:0/657829578 conn(0x7f06e406b6a0 msgr2=0x7f06e406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 -- 172.21.15.6:0/657829578 shutdown_connections 2023-12-19T13:33:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.307+0000 7f06ea355640 1 -- 172.21.15.6:0/657829578 wait complete. 2023-12-19T13:33:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.308+0000 7f06ea355640 1 Processor -- start 2023-12-19T13:33:30.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.308+0000 7f06ea355640 1 -- start start 2023-12-19T13:33:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06ea355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 0x7f06e414a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06ea355640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e40b8690 0x7f06e41491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06ea355640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e4144d80 0x7f06e4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06ea355640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4141640 con 0x7f06e40b77d0 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06ea355640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e414a550 con 0x7f06e4144d80 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06ea355640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4147690 con 0x7f06e40b8690 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 0x7f06e414a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 0x7f06e414a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44830/0 (socket says 172.21.15.6:44830) 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 -- 172.21.15.6:0/1407972382 learned_addr learned my addr 172.21.15.6:0/1407972382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e37fe640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e40b8690 0x7f06e41491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e88f2640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e4144d80 0x7f06e4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 -- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e40b8690 msgr2=0x7f06e41491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e40b8690 0x7f06e41491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 -- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e4144d80 msgr2=0x7f06e4138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e4144d80 0x7f06e4138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.309+0000 7f06e3fff640 1 -- 172.21.15.6:0/1407972382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc009b30 con 0x7f06e40b77d0 2023-12-19T13:33:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.310+0000 7f06e3fff640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 0x7f06e414a010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06d800c500 tx=0x7f06d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.310+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8007560 con 0x7f06e40b77d0 2023-12-19T13:33:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.310+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d80047e0 con 0x7f06e40b77d0 2023-12-19T13:33:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.310+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e41456f0 con 0x7f06e40b77d0 2023-12-19T13:33:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.310+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8004b90 con 0x7f06e40b77d0 2023-12-19T13:33:30.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.310+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e41498c0 con 0x7f06e40b77d0 2023-12-19T13:33:30.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.311+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4146660 con 0x7f06e40b77d0 2023-12-19T13:33:30.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.311+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06d8004cf0 con 0x7f06e40b77d0 2023-12-19T13:33:30.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.312+0000 7f06e0ff9640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f06d006a430 0x7f06d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.312+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06d80879f0 con 0x7f06e40b77d0 2023-12-19T13:33:30.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.312+0000 7f06e37fe640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f06d006a430 0x7f06d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.312+0000 7f06e37fe640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f06d006a430 0x7f06d006c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06e4143c80 tx=0x7f06d4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.316+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f06d8053120 con 0x7f06e40b77d0 2023-12-19T13:33:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.490+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06e4141430 con 0x7f06e40b77d0 2023-12-19T13:33:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.490+0000 7f06e0ff9640 1 -- 172.21.15.6:0/1407972382 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06d8018020 con 0x7f06e40b77d0 2023-12-19T13:33:30.492 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f06d006a430 msgr2=0x7f06d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f06d006a430 0x7f06d006c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06e4143c80 tx=0x7f06d4009190 comp rx=0 tx=0).stop 2023-12-19T13:33:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 msgr2=0x7f06e414a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 0x7f06e414a010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06d800c500 tx=0x7f06d800c9c0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 shutdown_connections 2023-12-19T13:33:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f06d006a430 0x7f06d006c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06e4144d80 0x7f06e4138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06e40b8690 0x7f06e41491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 --2- 172.21.15.6:0/1407972382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06e40b77d0 0x7f06e414a010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 >> 172.21.15.6:0/1407972382 conn(0x7f06e406b6a0 msgr2=0x7f06e40b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 shutdown_connections 2023-12-19T13:33:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.492+0000 7f06ea355640 1 -- 172.21.15.6:0/1407972382 wait complete. 2023-12-19T13:33:30.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:30.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.611+0000 7f0a069d0640 1 Processor -- start 2023-12-19T13:33:30.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.611+0000 7f0a069d0640 1 -- start start 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.611+0000 7f0a069d0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a000b8690 0x7f0a000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.611+0000 7f0a069d0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0014ab10 con 0x7f0a000b77d0 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.611+0000 7f0a069d0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0006c2f0 con 0x7f0a00144d80 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.611+0000 7f0a069d0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a000ba620 con 0x7f0a000b8690 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09ff7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0a000b77d0 0x7f0a00144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58712/0 (socket says 172.21.15.6:58712) 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09ff7fe640 1 -- 172.21.15.6:0/197537366 learned_addr learned my addr 172.21.15.6:0/197537366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09fffff640 1 --2- 172.21.15.6:0/197537366 >> v2:172.21.15.89:3300/0 conn(0x7f0a000b8690 0x7f0a000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378228760 0 0) 0x7f0a0014ab10 con 0x7f0a000b77d0 2023-12-19T13:33:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e8003520 con 0x7f0a000b77d0 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3339419540 0 0) 0x7f09e8003520 con 0x7f0a000b77d0 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 >> v2:172.21.15.89:3300/0 conn(0x7f0a000b8690 msgr2=0x7f0a000b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 --2- 172.21.15.6:0/197537366 >> v2:172.21.15.89:3300/0 conn(0x7f0a000b8690 0x7f0a000b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 >> v1:172.21.15.89:6789/0 conn(0x7f0a00144d80 legacy=0x7f0a0014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a000b9e60 con 0x7f0a000b77d0 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f09f4001670 con 0x7f0a000b77d0 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 >> v1:172.21.15.6:6789/0 conn(0x7f0a000b77d0 legacy=0x7f0a00144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8003970 0x7f09e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80047c0 0x7f09e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f09e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a000ba620 con 0x7f09e8005180 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e800c120 con 0x7f09e8003970 2023-12-19T13:33:30.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e800c2e0 con 0x7f09e80047c0 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f0a04f6d640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f09e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09fffff640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8003970 0x7f09e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.612+0000 7f09ff7fe640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80047c0 0x7f09e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 -- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80047c0 msgr2=0x7f09e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80047c0 0x7f09e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 -- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8003970 msgr2=0x7f09e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8003970 0x7f09e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 -- 172.21.15.6:0/197537366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8003520 con 0x7f09e8005180 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 -- 172.21.15.6:0/197537366 reap_dead start 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.613+0000 7f0a04f6d640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f09e800b980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f09f8001e20 tx=0x7f09e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a61b677c09e93d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8003b70 con 0x7f09e8005180 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8003cd0 con 0x7f09e8005180 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f09feffd640 1 -- 172.21.15.6:0/197537366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80052f0 con 0x7f09e8005180 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 -- 172.21.15.6:0/197537366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 msgr2=0x7f09e800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f09e800b980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f09f8001e20 tx=0x7f09e80057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 -- 172.21.15.6:0/197537366 shutdown_connections 2023-12-19T13:33:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 --2- 172.21.15.6:0/197537366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f09e800b980 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 -- 172.21.15.6:0/197537366 >> 172.21.15.6:0/197537366 conn(0x7f0a0006b6a0 msgr2=0x7f0a0006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 -- 172.21.15.6:0/197537366 shutdown_connections 2023-12-19T13:33:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.614+0000 7f0a069d0640 1 -- 172.21.15.6:0/197537366 wait complete. 2023-12-19T13:33:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.615+0000 7f0a069d0640 1 Processor -- start 2023-12-19T13:33:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.615+0000 7f0a069d0640 1 -- start start 2023-12-19T13:33:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a069d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f0a0013bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a069d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0014d330 0x7f0a00136d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a069d0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a00137270 0x7f0a001e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a069d0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0013c3e0 con 0x7f09e8005180 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a069d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0014bd80 con 0x7f0a0014d330 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a069d0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0014caf0 con 0x7f0a00137270 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f0a0013bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f0a0013bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44854/0 (socket says 172.21.15.6:44854) 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 -- 172.21.15.6:0/1081287433 learned_addr learned my addr 172.21.15.6:0/1081287433 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09ff7fe640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0014d330 0x7f0a00136d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 -- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a00137270 msgr2=0x7f0a001e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f0a04f6d640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a00137270 0x7f0a001e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a00137270 0x7f0a001e3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 -- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0014d330 msgr2=0x7f0a00136d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0014d330 0x7f0a00136d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09fffff640 1 -- 172.21.15.6:0/1081287433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0014cd90 con 0x7f09e8005180 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.616+0000 7f09ff7fe640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0014d330 0x7f0a00136d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.617+0000 7f09fffff640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f0a0013bea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09f0011910 tx=0x7f09f0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.617+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000faf0 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.617+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f000fc50 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.617+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0014440 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.617+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0014d070 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.617+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0013c650 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.618+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a00073a40 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.618+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09f00145a0 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.619+0000 7f09fcff9640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f09ec06a430 0x7f09ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.619+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09f00891e0 con 0x7f09e8005180 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.619+0000 7f09ff7fe640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f09ec06a430 0x7f09ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.619+0000 7f09ff7fe640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f09ec06a430 0x7f09ec06c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a000bb6a0 tx=0x7f09f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.623+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09f0054740 con 0x7f09e8005180 2023-12-19T13:33:30.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.799+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a0014a820 con 0x7f09e8005180 2023-12-19T13:33:30.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.800+0000 7f09fcff9640 1 -- 172.21.15.6:0/1081287433 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09f0057d60 con 0x7f09e8005180 2023-12-19T13:33:30.802 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.801+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f09ec06a430 msgr2=0x7f09ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.801+0000 7f0a069d0640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f09ec06a430 0x7f09ec06c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a000bb6a0 tx=0x7f09f4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.801+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 msgr2=0x7f0a0013bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.801+0000 7f0a069d0640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f0a0013bea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09f0011910 tx=0x7f09f0011dd0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 shutdown_connections 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f09ec06a430 0x7f09ec06c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a00137270 0x7f0a001e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0014d330 0x7f0a00136d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 --2- 172.21.15.6:0/1081287433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09e8005180 0x7f0a0013bea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 >> 172.21.15.6:0/1081287433 conn(0x7f0a0006b6a0 msgr2=0x7f0a0014aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 shutdown_connections 2023-12-19T13:33:30.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.802+0000 7f0a069d0640 1 -- 172.21.15.6:0/1081287433 wait complete. 2023-12-19T13:33:30.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.920+0000 7f5be4399640 1 Processor -- start 2023-12-19T13:33:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.920+0000 7f5be4399640 1 -- start start 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be4399640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bdc0b2e80 0x7f5bdc0b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be4399640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b7fb0 0x7f5bdc152130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be4399640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0b3ed0 con 0x7f5bdc0b8df0 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be4399640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0b91d0 con 0x7f5bdc0b2e80 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be4399640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc142030 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be1934640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bdc0b2e80 0x7f5bdc0b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be1934640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bdc0b2e80 0x7f5bdc0b7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44862/0 (socket says 172.21.15.6:44862) 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.921+0000 7f5be1934640 1 -- 172.21.15.6:0/391344544 learned_addr learned my addr 172.21.15.6:0/391344544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be2936640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b7fb0 0x7f5bdc152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be1934640 1 -- 172.21.15.6:0/391344544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b7fb0 msgr2=0x7f5bdc152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be1934640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b7fb0 0x7f5bdc152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be1934640 1 -- 172.21.15.6:0/391344544 >> v1:172.21.15.89:6789/0 conn(0x7f5bdc0b8df0 legacy=0x7f5bdc14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be1934640 1 -- 172.21.15.6:0/391344544 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0b27f0 con 0x7f5bdc0b2e80 2023-12-19T13:33:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be2936640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b7fb0 0x7f5bdc152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.922+0000 7f5be1934640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0b7a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009870 tx=0x7f5bcc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eebc1bb14495412 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be1133640 1 -- 172.21.15.6:0/391344544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc02f840 con 0x7f5bdc0b2e80 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be1133640 1 -- 172.21.15.6:0/391344544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc02f9a0 con 0x7f5bdc0b2e80 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be1133640 1 -- 172.21.15.6:0/391344544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc02fd30 con 0x7f5bdc0b2e80 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 -- 172.21.15.6:0/391344544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b2e80 msgr2=0x7f5bdc0b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0b7a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009870 tx=0x7f5bcc02ba20 comp rx=0 tx=0).stop 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 -- 172.21.15.6:0/391344544 shutdown_connections 2023-12-19T13:33:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0b7a70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 --2- 172.21.15.6:0/391344544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b7fb0 0x7f5bdc152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 -- 172.21.15.6:0/391344544 >> 172.21.15.6:0/391344544 conn(0x7f5bdc06ae10 msgr2=0x7f5bdc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 -- 172.21.15.6:0/391344544 shutdown_connections 2023-12-19T13:33:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.923+0000 7f5be4399640 1 -- 172.21.15.6:0/391344544 wait complete. 2023-12-19T13:33:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.924+0000 7f5be4399640 1 Processor -- start 2023-12-19T13:33:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.924+0000 7f5be4399640 1 -- start start 2023-12-19T13:33:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be4399640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be4399640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 0x7f5bdc0a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be4399640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b8df0 0x7f5bdc0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be4399640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0a1910 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be4399640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0a20a0 con 0x7f5bdc0b2e80 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be4399640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0b4260 con 0x7f5bdc0b8df0 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 0x7f5bdc0a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 0x7f5bdc0a27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44878/0 (socket says 172.21.15.6:44878) 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 -- 172.21.15.6:0/1460103870 learned_addr learned my addr 172.21.15.6:0/1460103870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be2135640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be2936640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b8df0 0x7f5bdc0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 -- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b8df0 msgr2=0x7f5bdc0a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b8df0 0x7f5bdc0a2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 -- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc0b2e80 msgr2=0x7f5bdc0a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.925+0000 7f5be1934640 1 -- 172.21.15.6:0/1460103870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0094d0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.926+0000 7f5be1934640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 0x7f5bdc0a27b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000c00 tx=0x7f5bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.926+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc03b040 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.926+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc037c40 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.926+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc041400 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.926+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc0a04b0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.926+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc0b44b0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.927+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc0a24d0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.927+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5bcc041560 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.928+0000 7f5bd2ffd640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5bc006a460 0x7f5bc006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.928+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bcc0ab510 con 0x7f5bdc0b7fb0 2023-12-19T13:33:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.928+0000 7f5be2135640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5bc006a460 0x7f5bc006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.928+0000 7f5be2135640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5bc006a460 0x7f5bc006c920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80016e0 tx=0x7f5bd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:30.932+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5bdc0a24d0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.107+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bdc0a24d0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.108+0000 7f5bd2ffd640 1 -- 172.21.15.6:0/1460103870 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5bdc0a24d0 con 0x7f5bdc0b7fb0 2023-12-19T13:33:31.110 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5bc006a460 msgr2=0x7f5bc006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5bc006a460 0x7f5bc006c920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80016e0 tx=0x7f5bd8009040 comp rx=0 tx=0).stop 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 msgr2=0x7f5bdc0a27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 0x7f5bdc0a27b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000c00 tx=0x7f5bcc0046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 shutdown_connections 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5bc006a460 0x7f5bc006c920 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b8df0 0x7f5bdc0a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bdc0b7fb0 0x7f5bdc0a27b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 --2- 172.21.15.6:0/1460103870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc0b2e80 0x7f5bdc0a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 >> 172.21.15.6:0/1460103870 conn(0x7f5bdc06ae10 msgr2=0x7f5bdc070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 shutdown_connections 2023-12-19T13:33:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.109+0000 7f5be4399640 1 -- 172.21.15.6:0/1460103870 wait complete. 2023-12-19T13:33:31.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-19T13:33:31.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 Processor -- start 2023-12-19T13:33:31.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 -- start start 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67200ba550 0x7f67200b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67201554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200bb310 con 0x7f672006a6d0 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67200bf960 con 0x7f67200ba550 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.226+0000 7f672510a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67200bb5b0 con 0x7f67200ba000 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67201554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671659c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67200ba550 0x7f67200b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67201554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:50006/0 (socket says 172.21.15.6:50006) 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671659c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67200ba550 0x7f67200b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:55776/0 (socket says 172.21.15.6:55776) 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671f59e640 1 -- 172.21.15.6:0/3397252956 learned_addr learned my addr 172.21.15.6:0/3397252956 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671ed9d640 1 --1- 172.21.15.6:0/3397252956 >> v1:172.21.15.89:6789/0 conn(0x7f672006a6d0 0x7f672014acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:38162/0 (socket says 172.21.15.6:38162) 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671e59c640 1 -- 172.21.15.6:0/3397252956 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271573977 0 0) 0x7f67200bb310 con 0x7f672006a6d0 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671e59c640 1 -- 172.21.15.6:0/3397252956 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6700003520 con 0x7f672006a6d0 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671659c640 1 -- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 msgr2=0x7f67201554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671659c640 1 --2- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67201554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671659c640 1 -- 172.21.15.6:0/3397252956 >> v1:172.21.15.89:6789/0 conn(0x7f672006a6d0 legacy=0x7f672014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671659c640 1 -- 172.21.15.6:0/3397252956 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200c0120 con 0x7f67200ba550 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.227+0000 7f671f59e640 1 --2- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67201554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.228+0000 7f671659c640 1 --2- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67200ba550 0x7f67200b9ac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67100097a0 tx=0x7f671002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7fc856f674a713d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.228+0000 7f671e59c640 1 -- 172.21.15.6:0/3397252956 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710031830 con 0x7f67200ba550 2023-12-19T13:33:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.228+0000 7f671e59c640 1 -- 172.21.15.6:0/3397252956 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710031990 con 0x7f67200ba550 2023-12-19T13:33:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.228+0000 7f671e59c640 1 -- 172.21.15.6:0/3397252956 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710031d20 con 0x7f67200ba550 2023-12-19T13:33:31.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 -- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67200ba550 msgr2=0x7f67200b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 --2- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67200ba550 0x7f67200b9ac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67100097a0 tx=0x7f671002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 -- 172.21.15.6:0/3397252956 shutdown_connections 2023-12-19T13:33:31.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 --2- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67200ba550 0x7f67200b9ac0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 --2- 172.21.15.6:0/3397252956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67201554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 -- 172.21.15.6:0/3397252956 >> 172.21.15.6:0/3397252956 conn(0x7f67200c0350 msgr2=0x7f67200c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 -- 172.21.15.6:0/3397252956 shutdown_connections 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.229+0000 7f672510a640 1 -- 172.21.15.6:0/3397252956 wait complete. 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.230+0000 7f672510a640 1 Processor -- start 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.230+0000 7f672510a640 1 -- start start 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672006a6d0 0x7f67200b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67200b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 0x7f67200b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67201e0430 con 0x7f67200ba550 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200b5f60 con 0x7f672006a6d0 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67201df820 con 0x7f67200ba000 2023-12-19T13:33:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 0x7f67200b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 0x7f67200b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44882/0 (socket says 172.21.15.6:44882) 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 -- 172.21.15.6:0/2377633307 learned_addr learned my addr 172.21.15.6:0/2377633307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671ed9d640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672006a6d0 0x7f67200b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671659c640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67200b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 -- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 msgr2=0x7f67200b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67200b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 -- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672006a6d0 msgr2=0x7f67200b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672006a6d0 0x7f67200b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 -- 172.21.15.6:0/2377633307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009b30 con 0x7f67200ba550 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671ed9d640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672006a6d0 0x7f67200b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f671f59e640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 0x7f67200b3e80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f671800efc0 tx=0x7f671800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718018070 con 0x7f67200ba550 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671800f040 con 0x7f67200ba550 2023-12-19T13:33:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6710009400 con 0x7f67200ba550 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.231+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800ce00 con 0x7f67200ba550 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.232+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67201dfde0 con 0x7f67200ba550 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.233+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67201e05a0 con 0x7f67200ba550 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.233+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6718014480 con 0x7f67200ba550 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.233+0000 7f6717fff640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f670406a460 0x7f670406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.233+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6718088be0 con 0x7f67200ba550 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.234+0000 7f671ed9d640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f670406a460 0x7f670406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.234+0000 7f671ed9d640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f670406a460 0x7f670406c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67080011e0 tx=0x7f6708007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.237+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6718054260 con 0x7f67200ba550 2023-12-19T13:33:31.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.481+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f6720073a40 con 0x7f67200ba550 2023-12-19T13:33:31.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.741+0000 7f6717fff640 1 -- 172.21.15.6:0/2377633307 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v43) v1 ==== 166+0+0 (secure 0 0 0) 0x7f6718057880 con 0x7f67200ba550 2023-12-19T13:33:31.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f670406a460 msgr2=0x7f670406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f670406a460 0x7f670406c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67080011e0 tx=0x7f6708007c10 comp rx=0 tx=0).stop 2023-12-19T13:33:31.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 msgr2=0x7f67200b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 0x7f67200b3e80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f671800efc0 tx=0x7f671800c490 comp rx=0 tx=0).stop 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 shutdown_connections 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f670406a460 0x7f670406c920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67200ba550 0x7f67200b3e80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67200ba000 0x7f67200b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 --2- 172.21.15.6:0/2377633307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672006a6d0 0x7f67200b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 >> 172.21.15.6:0/2377633307 conn(0x7f67200c0350 msgr2=0x7f67200b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 shutdown_connections 2023-12-19T13:33:31.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.743+0000 7f672510a640 1 -- 172.21.15.6:0/2377633307 wait complete. 2023-12-19T13:33:31.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T13:33:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.864+0000 7f1ddfd7e640 1 Processor -- start 2023-12-19T13:33:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.864+0000 7f1ddfd7e640 1 -- start start 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.864+0000 7f1ddfd7e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1dd8144dd0 0x7f1dd80bc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.864+0000 7f1ddfd7e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd814b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.864+0000 7f1ddfd7e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd814ac30 con 0x7f1dd80b8040 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1ddfd7e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd814bab0 con 0x7f1dd8144dd0 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1ddfd7e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80b9370 con 0x7f1dd814b0c0 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1dd8144dd0 0x7f1dd80bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dde31b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1dd8144dd0 0x7f1dd80bc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:55798/0 (socket says 172.21.15.6:55798) 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1ddd319640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1dd80b8040 0x7f1dd80b8c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:38174/0 (socket says 172.21.15.6:38174) 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 -- 172.21.15.6:0/3978833195 learned_addr learned my addr 172.21.15.6:0/3978833195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 -- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 msgr2=0x7f1dd814b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 --2- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd814b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 -- 172.21.15.6:0/3978833195 >> v1:172.21.15.89:6789/0 conn(0x7f1dd80b8040 legacy=0x7f1dd80b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1dddb1a640 1 -- 172.21.15.6:0/3978833195 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80c0f30 con 0x7f1dd8144dd0 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.865+0000 7f1ddcb18640 1 -- 172.21.15.6:0/3978833195 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118216945 0 0) 0x7f1dd814ac30 con 0x7f1dd80b8040 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.866+0000 7f1dddb1a640 1 --2- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd8144dd0 0x7f1dd80bc700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009870 tx=0x7f1dd402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6682db269834b93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.866+0000 7f1ddcb18640 1 -- 172.21.15.6:0/3978833195 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4031640 con 0x7f1dd8144dd0 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.866+0000 7f1ddcb18640 1 -- 172.21.15.6:0/3978833195 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd40317a0 con 0x7f1dd8144dd0 2023-12-19T13:33:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.866+0000 7f1ddcb18640 1 -- 172.21.15.6:0/3978833195 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4031b30 con 0x7f1dd8144dd0 2023-12-19T13:33:31.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd8144dd0 msgr2=0x7f1dd80bc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd8144dd0 0x7f1dd80bc700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009870 tx=0x7f1dd402b8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/3978833195 shutdown_connections 2023-12-19T13:33:31.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd814b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/3978833195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd8144dd0 0x7f1dd80bc700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/3978833195 >> 172.21.15.6:0/3978833195 conn(0x7f1dd80c03d0 msgr2=0x7f1dd80c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/3978833195 shutdown_connections 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.867+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/3978833195 wait complete. 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 Processor -- start 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 -- start start 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd80b8040 0x7f1dd8145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 0x7f1dd81472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd8147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80b0150 con 0x7f1dd8144dd0 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8145b70 con 0x7f1dd80b8040 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.868+0000 7f1ddfd7e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8146cc0 con 0x7f1dd814b0c0 2023-12-19T13:33:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 0x7f1dd81472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 0x7f1dd81472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44892/0 (socket says 172.21.15.6:44892) 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 -- 172.21.15.6:0/4201787827 learned_addr learned my addr 172.21.15.6:0/4201787827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1dddb1a640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd80b8040 0x7f1dd8145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1dde31b640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd8147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 -- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 msgr2=0x7f1dd8147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd8147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 -- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd80b8040 msgr2=0x7f1dd8145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd80b8040 0x7f1dd8145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 -- 172.21.15.6:0/4201787827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40094d0 con 0x7f1dd8144dd0 2023-12-19T13:33:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1dddb1a640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd80b8040 0x7f1dd8145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddd319640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 0x7f1dd81472c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c4d0 tx=0x7f1dc800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80074e0 con 0x7f1dd8144dd0 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8007660 con 0x7f1dd8144dd0 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd81e0110 con 0x7f1dd8144dd0 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004a20 con 0x7f1dd8144dd0 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.869+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd81e06d0 con 0x7f1dd8144dd0 2023-12-19T13:33:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.870+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd81e08f0 con 0x7f1dd8144dd0 2023-12-19T13:33:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.871+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1dc8004b80 con 0x7f1dd8144dd0 2023-12-19T13:33:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.871+0000 7f1dce7fc640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1dbc06a430 0x7f1dbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.871+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dc8087a90 con 0x7f1dd8144dd0 2023-12-19T13:33:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.871+0000 7f1dddb1a640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1dbc06a430 0x7f1dbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.872+0000 7f1dddb1a640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1dbc06a430 0x7f1dbc06c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4036000 tx=0x7f1dd403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:31.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:31.875+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1dc80530a0 con 0x7f1dd8144dd0 2023-12-19T13:33:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.056+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1dd81dff60 con 0x7f1dd8144dd0 2023-12-19T13:33:32.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.061+0000 7f1dce7fc640 1 -- 172.21.15.6:0/4201787827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1dc80566c0 con 0x7f1dd8144dd0 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.063+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1dbc06a430 msgr2=0x7f1dbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.063+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1dbc06a430 0x7f1dbc06c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4036000 tx=0x7f1dd403d040 comp rx=0 tx=0).stop 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.063+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 msgr2=0x7f1dd81472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.063+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 0x7f1dd81472c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c4d0 tx=0x7f1dc800c990 comp rx=0 tx=0).stop 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 shutdown_connections 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1dbc06a430 0x7f1dbc06c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dd814b0c0 0x7f1dd8147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd8144dd0 0x7f1dd81472c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 --2- 172.21.15.6:0/4201787827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dd80b8040 0x7f1dd8145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 >> 172.21.15.6:0/4201787827 conn(0x7f1dd80c03d0 msgr2=0x7f1dd8144220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 shutdown_connections 2023-12-19T13:33:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.064+0000 7f1ddfd7e640 1 -- 172.21.15.6:0/4201787827 wait complete. 2023-12-19T13:33:32.076 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T13:33:32.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:33:32.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:33:32.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T13:33:32.465 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T13:33:32.465 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:33:32.466 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:33:32.521 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:33:32.521 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:33:32.574 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:33:32.574 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:33:32.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.738+0000 7f251095c640 1 Processor -- start 2023-12-19T13:33:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.738+0000 7f251095c640 1 -- start start 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f251095c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 0x7f250c070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f251095c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 0x7f250c141b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f251095c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c071c80 con 0x7f250c0b2ed0 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f251095c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c1487f0 con 0x7f250c141680 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f251095c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0715e0 con 0x7f250c06a390 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f250a59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 0x7f250c070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f250ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 0x7f250c141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f250a59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 0x7f250c070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:50038/0 (socket says 172.21.15.6:50038) 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f250ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 0x7f250c141b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:55810/0 (socket says 172.21.15.6:55810) 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.739+0000 7f250a59c640 1 -- 172.21.15.6:0/3294142551 learned_addr learned my addr 172.21.15.6:0/3294142551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.740+0000 7f250a59c640 1 -- 172.21.15.6:0/3294142551 >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 msgr2=0x7f250c141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.740+0000 7f250a59c640 1 --2- 172.21.15.6:0/3294142551 >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 0x7f250c141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.740+0000 7f250a59c640 1 -- 172.21.15.6:0/3294142551 >> v1:172.21.15.89:6789/0 conn(0x7f250c0b2ed0 legacy=0x7f250c1480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.740+0000 7f250a59c640 1 -- 172.21.15.6:0/3294142551 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0718c0 con 0x7f250c06a390 2023-12-19T13:33:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.740+0000 7f250ad9d640 1 --2- 172.21.15.6:0/3294142551 >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 0x7f250c141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.740+0000 7f250a59c640 1 --2- 172.21.15.6:0/3294142551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 0x7f250c070fc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009e50 tx=0x7f24fc02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c41ba25ad47b6d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.743+0000 7f250959a640 1 -- 172.21.15.6:0/3294142551 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc02cb90 con 0x7f250c06a390 2023-12-19T13:33:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.743+0000 7f250959a640 1 -- 172.21.15.6:0/3294142551 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc02ccf0 con 0x7f250c06a390 2023-12-19T13:33:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.743+0000 7f250959a640 1 -- 172.21.15.6:0/3294142551 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc034610 con 0x7f250c06a390 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.743+0000 7f251095c640 1 -- 172.21.15.6:0/3294142551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 msgr2=0x7f250c070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.743+0000 7f251095c640 1 --2- 172.21.15.6:0/3294142551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 0x7f250c070fc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009e50 tx=0x7f24fc02bff0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.744+0000 7f251095c640 1 -- 172.21.15.6:0/3294142551 shutdown_connections 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.744+0000 7f251095c640 1 --2- 172.21.15.6:0/3294142551 >> v2:172.21.15.89:3300/0 conn(0x7f250c141680 0x7f250c141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.744+0000 7f251095c640 1 --2- 172.21.15.6:0/3294142551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c06a390 0x7f250c070fc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.744+0000 7f251095c640 1 -- 172.21.15.6:0/3294142551 >> 172.21.15.6:0/3294142551 conn(0x7f250c0bc330 msgr2=0x7f250c0bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.744+0000 7f251095c640 1 -- 172.21.15.6:0/3294142551 shutdown_connections 2023-12-19T13:33:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.744+0000 7f251095c640 1 -- 172.21.15.6:0/3294142551 wait complete. 2023-12-19T13:33:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.745+0000 7f251095c640 1 Processor -- start 2023-12-19T13:33:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.745+0000 7f251095c640 1 -- start start 2023-12-19T13:33:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f251095c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f250c06a390 0x7f250c146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f251095c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 0x7f250c1deea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f251095c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c146a60 0x7f250c1df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f251095c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c144ca0 con 0x7f250c141680 2023-12-19T13:33:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f251095c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c1458b0 con 0x7f250c06a390 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f251095c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c144300 con 0x7f250c146a60 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f2509d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 0x7f250c1deea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f250a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f250c06a390 0x7f250c146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f2509d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 0x7f250c1deea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44908/0 (socket says 172.21.15.6:44908) 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f2509d9b640 1 -- 172.21.15.6:0/2203853299 learned_addr learned my addr 172.21.15.6:0/2203853299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.746+0000 7f250ad9d640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c146a60 0x7f250c1df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f2509d9b640 1 -- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c146a60 msgr2=0x7f250c1df3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f2509d9b640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c146a60 0x7f250c1df3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f2509d9b640 1 -- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f250c06a390 msgr2=0x7f250c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f2509d9b640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f250c06a390 0x7f250c146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f2509d9b640 1 -- 172.21.15.6:0/2203853299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250400b6a0 con 0x7f250c141680 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f2509d9b640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 0x7f250c1deea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f250000c430 tx=0x7f250000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000052d0 con 0x7f250c141680 2023-12-19T13:33:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc009b30 con 0x7f250c141680 2023-12-19T13:33:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500005450 con 0x7f250c141680 2023-12-19T13:33:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500007260 con 0x7f250c141680 2023-12-19T13:33:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.747+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c1448c0 con 0x7f250c141680 2023-12-19T13:33:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.748+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c073a40 con 0x7f250c141680 2023-12-19T13:33:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.749+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25000073c0 con 0x7f250c141680 2023-12-19T13:33:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.749+0000 7f24faffd640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f24ec06a430 0x7f24ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.749+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2500087cf0 con 0x7f250c141680 2023-12-19T13:33:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.749+0000 7f250a59c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f24ec06a430 0x7f24ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.750+0000 7f250a59c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f24ec06a430 0x7f24ec06c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24fc035000 tx=0x7f24fc030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:32.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.753+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2500053270 con 0x7f250c141680 2023-12-19T13:33:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.932+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f250c145ab0 con 0x7f250c141680 2023-12-19T13:33:32.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.933+0000 7f24faffd640 1 -- 172.21.15.6:0/2203853299 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f2500056890 con 0x7f250c141680 2023-12-19T13:33:32.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:32.936 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f24ec06a430 msgr2=0x7f24ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f24ec06a430 0x7f24ec06c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24fc035000 tx=0x7f24fc030000 comp rx=0 tx=0).stop 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 msgr2=0x7f250c1deea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 0x7f250c1deea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f250000c430 tx=0x7f250000c830 comp rx=0 tx=0).stop 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 shutdown_connections 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f24ec06a430 0x7f24ec06c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f250c146a60 0x7f250c1df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250c141680 0x7f250c1deea0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 --2- 172.21.15.6:0/2203853299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f250c06a390 0x7f250c146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 >> 172.21.15.6:0/2203853299 conn(0x7f250c0bc330 msgr2=0x7f250c06f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 shutdown_connections 2023-12-19T13:33:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:32.935+0000 7f251095c640 1 -- 172.21.15.6:0/2203853299 wait complete. 2023-12-19T13:33:32.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:32.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.055+0000 7f5ab7adb640 1 Processor -- start 2023-12-19T13:33:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.055+0000 7f5ab7adb640 1 -- start start 2023-12-19T13:33:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab7adb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 0x7f5ab00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab7adb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab014ab10 con 0x7f5ab0144d80 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab7adb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab006c2f0 con 0x7f5ab00b8690 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab7adb640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00ba620 con 0x7f5ab00b77d0 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab5076640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ab0144d80 0x7f5ab014afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58728/0 (socket says 172.21.15.6:58728) 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab5076640 1 -- 172.21.15.6:0/1453638376 learned_addr learned my addr 172.21.15.6:0/1453638376 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab6078640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 0x7f5ab00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872074780 0 0) 0x7f5ab014ab10 con 0x7f5ab0144d80 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a9c003520 con 0x7f5ab0144d80 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910006002 0 0) 0x7f5a9c003520 con 0x7f5ab0144d80 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 msgr2=0x7f5ab00b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 0x7f5ab00b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 >> v1:172.21.15.89:6789/0 conn(0x7f5ab00b8690 legacy=0x7f5ab0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00b9e60 con 0x7f5ab0144d80 2023-12-19T13:33:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f5aa0001670 con 0x7f5ab0144d80 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 >> v1:172.21.15.6:6789/0 conn(0x7f5ab0144d80 legacy=0x7f5ab014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a9c0039a0 0x7f5a9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5a9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 0x7f5a9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00ba620 con 0x7f5a9c0047c0 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c00bab0 con 0x7f5a9c0039a0 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c00bc70 con 0x7f5ab00b77d0 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab5076640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5a9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.056+0000 7f5ab5877640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a9c0039a0 0x7f5a9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab6078640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 0x7f5a9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab5076640 1 -- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 msgr2=0x7f5a9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab5076640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab00b77d0 0x7f5a9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab5076640 1 -- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a9c0039a0 msgr2=0x7f5a9c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab5076640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a9c0039a0 0x7f5a9c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab5076640 1 -- 172.21.15.6:0/1453638376 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c003520 con 0x7f5a9c0047c0 2023-12-19T13:33:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.057+0000 7f5ab5076640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5a9c004c40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0001050 tx=0x7f5a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfe582db2a82970 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0005ad0 con 0x7f5a9c0047c0 2023-12-19T13:33:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0005c30 con 0x7f5a9c0047c0 2023-12-19T13:33:33.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab4875640 1 -- 172.21.15.6:0/1453638376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa002c890 con 0x7f5a9c0047c0 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab7adb640 1 -- 172.21.15.6:0/1453638376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 msgr2=0x7f5a9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/1453638376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5a9c004c40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0001050 tx=0x7f5a9c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab6078640 1 -- 172.21.15.6:0/1453638376 reap_dead start 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab7adb640 1 -- 172.21.15.6:0/1453638376 shutdown_connections 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab7adb640 1 -- 172.21.15.6:0/1453638376 >> 172.21.15.6:0/1453638376 conn(0x7f5ab006b6a0 msgr2=0x7f5ab006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab7adb640 1 -- 172.21.15.6:0/1453638376 shutdown_connections 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.058+0000 7f5ab7adb640 1 -- 172.21.15.6:0/1453638376 wait complete. 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.059+0000 7f5ab7adb640 1 Processor -- start 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.059+0000 7f5ab7adb640 1 -- start start 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab7adb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5ab0140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab7adb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab01475c0 0x7f5ab0139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab7adb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ab013a430 0x7f5ab01484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab7adb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0141500 con 0x7f5a9c0047c0 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab7adb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0147130 con 0x7f5ab013a430 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab7adb640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab014a170 con 0x7f5ab01475c0 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5ab0140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5ab0140fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44916/0 (socket says 172.21.15.6:44916) 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 -- 172.21.15.6:0/2401885352 learned_addr learned my addr 172.21.15.6:0/2401885352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5076640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab01475c0 0x7f5ab0139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab6078640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ab013a430 0x7f5ab01484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 -- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab01475c0 msgr2=0x7f5ab0139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab01475c0 0x7f5ab0139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 -- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ab013a430 msgr2=0x7f5ab01484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ab013a430 0x7f5ab01484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 -- 172.21.15.6:0/2401885352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab014adb0 con 0x7f5a9c0047c0 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab6078640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ab013a430 0x7f5ab01484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.060+0000 7f5ab5877640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5ab0140fc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00f620 tx=0x7f5aac00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.061+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0052e0 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.061+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac005440 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.061+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab014b040 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.061+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac003810 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.061+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab014b980 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.062+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab0073a40 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.062+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5aac003970 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.062+0000 7f5aa67fc640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9406a460 0x7f5a9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.063+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5aac088740 con 0x7f5a9c0047c0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.063+0000 7f5ab5076640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9406a460 0x7f5a9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.063+0000 7f5ab5076640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9406a460 0x7f5a9406c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0034000 tx=0x7f5aa0037040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.067+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5aac053d30 con 0x7f5a9c0047c0 2023-12-19T13:33:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.243+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab00b8030 con 0x7f5a9c0047c0 2023-12-19T13:33:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.243+0000 7f5aa67fc640 1 -- 172.21.15.6:0/2401885352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aac057350 con 0x7f5a9c0047c0 2023-12-19T13:33:33.245 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9406a460 msgr2=0x7f5a9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9406a460 0x7f5a9406c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0034000 tx=0x7f5aa0037040 comp rx=0 tx=0).stop 2023-12-19T13:33:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 msgr2=0x7f5ab0140fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5ab0140fc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00f620 tx=0x7f5aac00fae0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 shutdown_connections 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9406a460 0x7f5a9406c920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ab013a430 0x7f5ab01484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ab01475c0 0x7f5ab0139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 --2- 172.21.15.6:0/2401885352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9c0047c0 0x7f5ab0140fc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 >> 172.21.15.6:0/2401885352 conn(0x7f5ab006b6a0 msgr2=0x7f5ab0142100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 shutdown_connections 2023-12-19T13:33:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.245+0000 7f5ab7adb640 1 -- 172.21.15.6:0/2401885352 wait complete. 2023-12-19T13:33:33.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 Processor -- start 2023-12-19T13:33:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 -- start start 2023-12-19T13:33:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed8144ff0 0x7f8ed80bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ed80b77c0 0x7f8ed81554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80b6f30 con 0x7f8ed80b81f0 2023-12-19T13:33:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80b96a0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.364+0000 7f8ee0638640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80bc740 con 0x7f8ed8144ff0 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8eddbd3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8ed80b81f0 0x7f8ed814e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58736/0 (socket says 172.21.15.6:58736) 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8eddbd3640 1 -- 172.21.15.6:0/2520986504 learned_addr learned my addr 172.21.15.6:0/2520986504 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8ede3d4640 1 --2- 172.21.15.6:0/2520986504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed8144ff0 0x7f8ed80bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8edebd5640 1 --2- 172.21.15.6:0/2520986504 >> v2:172.21.15.89:3300/0 conn(0x7f8ed80b77c0 0x7f8ed81554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8edd3d2640 1 -- 172.21.15.6:0/2520986504 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337147839 0 0) 0x7f8ec8001110 con 0x7f8ed80b81f0 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8edd3d2640 1 -- 172.21.15.6:0/2520986504 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec4003520 con 0x7f8ed80b81f0 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8ede3d4640 1 -- 172.21.15.6:0/2520986504 >> v2:172.21.15.89:3300/0 conn(0x7f8ed80b77c0 msgr2=0x7f8ed81554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8ede3d4640 1 --2- 172.21.15.6:0/2520986504 >> v2:172.21.15.89:3300/0 conn(0x7f8ed80b77c0 0x7f8ed81554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8ede3d4640 1 -- 172.21.15.6:0/2520986504 >> v1:172.21.15.6:6789/0 conn(0x7f8ed80b81f0 legacy=0x7f8ed814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.365+0000 7f8ede3d4640 1 -- 172.21.15.6:0/2520986504 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80b8c50 con 0x7f8ed8144ff0 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.366+0000 7f8ede3d4640 1 --2- 172.21.15.6:0/2520986504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed8144ff0 0x7f8ed80bd1b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097a0 tx=0x7f8ed402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de9dab29082d2b56 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.366+0000 7f8edd3d2640 1 -- 172.21.15.6:0/2520986504 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4031830 con 0x7f8ed8144ff0 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.366+0000 7f8edd3d2640 1 -- 172.21.15.6:0/2520986504 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed4031990 con 0x7f8ed8144ff0 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.366+0000 7f8edd3d2640 1 -- 172.21.15.6:0/2520986504 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4031d00 con 0x7f8ed8144ff0 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 -- 172.21.15.6:0/2520986504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed8144ff0 msgr2=0x7f8ed80bd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 --2- 172.21.15.6:0/2520986504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed8144ff0 0x7f8ed80bd1b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097a0 tx=0x7f8ed402b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 -- 172.21.15.6:0/2520986504 shutdown_connections 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 --2- 172.21.15.6:0/2520986504 >> v2:172.21.15.89:3300/0 conn(0x7f8ed80b77c0 0x7f8ed81554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 --2- 172.21.15.6:0/2520986504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed8144ff0 0x7f8ed80bd1b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 -- 172.21.15.6:0/2520986504 >> 172.21.15.6:0/2520986504 conn(0x7f8ed8071610 msgr2=0x7f8ed80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 -- 172.21.15.6:0/2520986504 shutdown_connections 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.367+0000 7f8ee0638640 1 -- 172.21.15.6:0/2520986504 wait complete. 2023-12-19T13:33:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 Processor -- start 2023-12-19T13:33:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 -- start start 2023-12-19T13:33:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 0x7f8ed80b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed80b81f0 0x7f8ed80bf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ed8144ff0 0x7f8ed80be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b5ea0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed814ee50 con 0x7f8ed8144ff0 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.368+0000 7f8ee0638640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c0ce0 con 0x7f8ed80b81f0 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 0x7f8ed80b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 0x7f8ed80b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44922/0 (socket says 172.21.15.6:44922) 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 -- 172.21.15.6:0/580186934 learned_addr learned my addr 172.21.15.6:0/580186934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8eddbd3640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed80b81f0 0x7f8ed80bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8edebd5640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ed8144ff0 0x7f8ed80be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 -- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed80b81f0 msgr2=0x7f8ed80bf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed80b81f0 0x7f8ed80bf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 -- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ed8144ff0 msgr2=0x7f8ed80be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ed8144ff0 0x7f8ed80be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 -- 172.21.15.6:0/580186934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4009400 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ede3d4640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 0x7f8ed80b5960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40098c0 tx=0x7f8ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed403a630 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed403a790 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80c0fc0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed403ab40 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.369+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80bfbd0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.370+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed80c11d0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.371+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ed403aca0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.371+0000 7f8eceffd640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ebc06a460 0x7f8ebc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.371+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ed40aa1d0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.371+0000 7f8eddbd3640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ebc06a460 0x7f8ebc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.372+0000 7f8eddbd3640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ebc06a460 0x7f8ebc06c920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8071b50 tx=0x7f8ec8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.375+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ed40759a0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.549+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ed8073a40 con 0x7f8ed80b77c0 2023-12-19T13:33:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.549+0000 7f8eceffd640 1 -- 172.21.15.6:0/580186934 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ed4078fc0 con 0x7f8ed80b77c0 2023-12-19T13:33:33.551 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ebc06a460 msgr2=0x7f8ebc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ebc06a460 0x7f8ebc06c920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8071b50 tx=0x7f8ec8009040 comp rx=0 tx=0).stop 2023-12-19T13:33:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 msgr2=0x7f8ed80b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 0x7f8ed80b5960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40098c0 tx=0x7f8ed40046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 shutdown_connections 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f8ebc06a460 0x7f8ebc06c920 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ed8144ff0 0x7f8ed80be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ed80b81f0 0x7f8ed80bf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 --2- 172.21.15.6:0/580186934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80b77c0 0x7f8ed80b5960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 >> 172.21.15.6:0/580186934 conn(0x7f8ed8071610 msgr2=0x7f8ed8142e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 shutdown_connections 2023-12-19T13:33:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.551+0000 7f8ee0638640 1 -- 172.21.15.6:0/580186934 wait complete. 2023-12-19T13:33:33.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.672+0000 7fd7eb0b6640 1 Processor -- start 2023-12-19T13:33:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.672+0000 7fd7eb0b6640 1 -- start start 2023-12-19T13:33:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7eb0b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7eb0b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 0x7fd7e4144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7eb0b6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e414ab10 con 0x7fd7e4144bb0 2023-12-19T13:33:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7eb0b6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e406c2f0 con 0x7fd7e40b77d0 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7eb0b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40ba620 con 0x7fd7e40b8690 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e8e52640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 0x7fd7e4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 0x7fd7e4144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:55888/0 (socket says 172.21.15.6:55888) 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e8e52640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e40b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:50102/0 (socket says 172.21.15.6:50102) 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e3fff640 1 -- 172.21.15.6:0/3102418628 learned_addr learned my addr 172.21.15.6:0/3102418628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e9653640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd7e4144bb0 0x7fd7e414afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:38198/0 (socket says 172.21.15.6:38198) 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e8e52640 1 -- 172.21.15.6:0/3102418628 >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 msgr2=0x7fd7e4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e8e52640 1 --2- 172.21.15.6:0/3102418628 >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 0x7fd7e4144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.673+0000 7fd7e8e52640 1 -- 172.21.15.6:0/3102418628 >> v1:172.21.15.89:6789/0 conn(0x7fd7e4144bb0 legacy=0x7fd7e414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e37fe640 1 -- 172.21.15.6:0/3102418628 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194253472 0 0) 0x7fd7e414ab10 con 0x7fd7e4144bb0 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e8e52640 1 -- 172.21.15.6:0/3102418628 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40b9e60 con 0x7fd7e40b8690 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e3fff640 1 --2- 172.21.15.6:0/3102418628 >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 0x7fd7e4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e8e52640 1 --2- 172.21.15.6:0/3102418628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e40b8a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d5ffa6c7b2288d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e37fe640 1 -- 172.21.15.6:0/3102418628 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02cbc0 con 0x7fd7e40b8690 2023-12-19T13:33:33.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e37fe640 1 -- 172.21.15.6:0/3102418628 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02cd20 con 0x7fd7e40b8690 2023-12-19T13:33:33.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.674+0000 7fd7e37fe640 1 -- 172.21.15.6:0/3102418628 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc034660 con 0x7fd7e40b8690 2023-12-19T13:33:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/3102418628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 msgr2=0x7fd7e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/3102418628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e40b8a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc02be10 comp rx=0 tx=0).stop 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/3102418628 shutdown_connections 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/3102418628 >> v2:172.21.15.89:3300/0 conn(0x7fd7e40b77d0 0x7fd7e4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/3102418628 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e40b8a70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/3102418628 >> 172.21.15.6:0/3102418628 conn(0x7fd7e406b6a0 msgr2=0x7fd7e406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/3102418628 shutdown_connections 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.675+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/3102418628 wait complete. 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.676+0000 7fd7eb0b6640 1 Processor -- start 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.676+0000 7fd7eb0b6640 1 -- start start 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7eb0b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 0x7fd7e4140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7eb0b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e4149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7eb0b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4144bb0 0x7fd7e413ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7eb0b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e414a360 con 0x7fd7e40b77d0 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7eb0b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e413f390 con 0x7fd7e4144bb0 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7eb0b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4141280 con 0x7fd7e40b8690 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 0x7fd7e4140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 0x7fd7e4140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44928/0 (socket says 172.21.15.6:44928) 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 -- 172.21.15.6:0/988231179 learned_addr learned my addr 172.21.15.6:0/988231179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e9653640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4144bb0 0x7fd7e413ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e3fff640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e4149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 -- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 msgr2=0x7fd7e4149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e4149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 -- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4144bb0 msgr2=0x7fd7e413ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4144bb0 0x7fd7e413ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 -- 172.21.15.6:0/988231179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0094d0 con 0x7fd7e40b77d0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.677+0000 7fd7e8e52640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 0x7fd7e4140ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.678+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc040650 con 0x7fd7e40b77d0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.678+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02ce90 con 0x7fd7e40b77d0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.678+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc009a70 con 0x7fd7e40b77d0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.678+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0409f0 con 0x7fd7e40b77d0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.678+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e41e3460 con 0x7fd7e40b77d0 2023-12-19T13:33:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.679+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e41e2fb0 con 0x7fd7e40b77d0 2023-12-19T13:33:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.679+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7dc040b50 con 0x7fd7e40b77d0 2023-12-19T13:33:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.679+0000 7fd7e17fa640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd7c406a460 0x7fd7c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.680+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7dc0ab3f0 con 0x7fd7e40b77d0 2023-12-19T13:33:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.680+0000 7fd7e3fff640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd7c406a460 0x7fd7c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.680+0000 7fd7e3fff640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd7c406a460 0x7fd7c406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7e413ede0 tx=0x7fd7cc009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.684+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd7dc076b20 con 0x7fd7e40b77d0 2023-12-19T13:33:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.862+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7e41e2db0 con 0x7fd7e40b77d0 2023-12-19T13:33:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.862+0000 7fd7e17fa640 1 -- 172.21.15.6:0/988231179 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7dc07a140 con 0x7fd7e40b77d0 2023-12-19T13:33:33.864 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.864+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd7c406a460 msgr2=0x7fd7c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.864+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd7c406a460 0x7fd7c406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7e413ede0 tx=0x7fd7cc009240 comp rx=0 tx=0).stop 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.864+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 msgr2=0x7fd7e4140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.864+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 0x7fd7e4140ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 shutdown_connections 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd7c406a460 0x7fd7c406c920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4144bb0 0x7fd7e413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7e40b8690 0x7fd7e4149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 --2- 172.21.15.6:0/988231179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e40b77d0 0x7fd7e4140ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 >> 172.21.15.6:0/988231179 conn(0x7fd7e406b6a0 msgr2=0x7fd7e4142530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 shutdown_connections 2023-12-19T13:33:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.865+0000 7fd7eb0b6640 1 -- 172.21.15.6:0/988231179 wait complete. 2023-12-19T13:33:33.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T13:33:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.982+0000 7fb46f5c4640 1 Processor -- start 2023-12-19T13:33:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46f5c4640 1 -- start start 2023-12-19T13:33:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46f5c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 0x7fb46806a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46f5c4640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb468070b50 con 0x7fb46806a0e0 2023-12-19T13:33:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46f5c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb468143240 con 0x7fb46806fd70 2023-12-19T13:33:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46f5c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb468071690 con 0x7fb468069d00 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46db61640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb46806a0e0 0x7fb468153360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58748/0 (socket says 172.21.15.6:58748) 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.983+0000 7fb46db61640 1 -- 172.21.15.6:0/2243336044 learned_addr learned my addr 172.21.15.6:0/2243336044 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 0x7fb46806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086544117 0 0) 0x7fb460001490 con 0x7fb46806a0e0 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb454003520 con 0x7fb46806a0e0 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2434925759 0 0) 0x7fb454003520 con 0x7fb46806a0e0 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 msgr2=0x7fb46806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 0x7fb46806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 >> v1:172.21.15.89:6789/0 conn(0x7fb46806fd70 legacy=0x7fb468149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468070200 con 0x7fb46806a0e0 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fb460001b80 con 0x7fb46806a0e0 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 >> v1:172.21.15.6:6789/0 conn(0x7fb46806a0e0 legacy=0x7fb468153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4540039a0 0x7fb454003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 0x7fb4540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb454004d00 0x7fb454005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb468071690 con 0x7fb4540039a0 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400ba30 con 0x7fb454004d00 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400bbf0 con 0x7fb468069d00 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4540039a0 0x7fb454003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46cb5f640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 0x7fb4540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46db61640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb454004d00 0x7fb454005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 -- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 msgr2=0x7fb4540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb468069d00 0x7fb4540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 -- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb454004d00 msgr2=0x7fb454005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb454004d00 0x7fb454005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.984+0000 7fb46d360640 1 -- 172.21.15.6:0/2243336044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454003520 con 0x7fb4540039a0 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.985+0000 7fb46d360640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4540039a0 0x7fb454003d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb464009ac0 tx=0x7fb4540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba3364761f6a1f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.985+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46402c6b0 con 0x7fb4540039a0 2023-12-19T13:33:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.985+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46402c810 con 0x7fb4540039a0 2023-12-19T13:33:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.985+0000 7fb45ffff640 1 -- 172.21.15.6:0/2243336044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46402cba0 con 0x7fb4540039a0 2023-12-19T13:33:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46f5c4640 1 -- 172.21.15.6:0/2243336044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4540039a0 msgr2=0x7fb454003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/2243336044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4540039a0 0x7fb454003d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb464009ac0 tx=0x7fb4540057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46db61640 1 -- 172.21.15.6:0/2243336044 reap_dead start 2023-12-19T13:33:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46f5c4640 1 -- 172.21.15.6:0/2243336044 shutdown_connections 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46f5c4640 1 -- 172.21.15.6:0/2243336044 >> 172.21.15.6:0/2243336044 conn(0x7fb46806ae10 msgr2=0x7fb46806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46f5c4640 1 -- 172.21.15.6:0/2243336044 shutdown_connections 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.986+0000 7fb46f5c4640 1 -- 172.21.15.6:0/2243336044 wait complete. 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.987+0000 7fb46f5c4640 1 Processor -- start 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.987+0000 7fb46f5c4640 1 -- start start 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4540039a0 0x7fb4680b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 0x7fb4681e1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681e1670 0x7fb468139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680b5f90 con 0x7fb46814b0b0 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680b4440 con 0x7fb4540039a0 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680b5170 con 0x7fb4681e1670 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 0x7fb4681e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 0x7fb4681e1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44944/0 (socket says 172.21.15.6:44944) 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 -- 172.21.15.6:0/4261190398 learned_addr learned my addr 172.21.15.6:0/4261190398 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46d360640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4540039a0 0x7fb4680b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46db61640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681e1670 0x7fb468139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 -- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681e1670 msgr2=0x7fb468139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681e1670 0x7fb468139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 -- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4540039a0 msgr2=0x7fb4680b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4540039a0 0x7fb4680b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 -- 172.21.15.6:0/4261190398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46814b510 con 0x7fb46814b0b0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46cb5f640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 0x7fb4681e1130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb45800f780 tx=0x7fb45800fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800fe90 con 0x7fb46814b0b0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4580052e0 con 0x7fb46814b0b0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4680b4690 con 0x7fb46814b0b0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.988+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800d730 con 0x7fb46814b0b0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.989+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4680b4c50 con 0x7fb46814b0b0 2023-12-19T13:33:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.989+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4680b4e70 con 0x7fb46814b0b0 2023-12-19T13:33:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.990+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb45800d8b0 con 0x7fb46814b0b0 2023-12-19T13:33:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.990+0000 7fb45dffb640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb44c06a430 0x7fb44c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.990+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb458088970 con 0x7fb46814b0b0 2023-12-19T13:33:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.991+0000 7fb46d360640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb44c06a430 0x7fb44c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.991+0000 7fb46d360640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb44c06a430 0x7fb44c06c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb464036000 tx=0x7fb464030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:33.994+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb458053f50 con 0x7fb46814b0b0 2023-12-19T13:33:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.183+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb468073a40 con 0x7fb46814b0b0 2023-12-19T13:33:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.184+0000 7fb45dffb640 1 -- 172.21.15.6:0/4261190398 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb458057570 con 0x7fb46814b0b0 2023-12-19T13:33:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.185+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb44c06a430 msgr2=0x7fb44c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.185+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb44c06a430 0x7fb44c06c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb464036000 tx=0x7fb464030000 comp rx=0 tx=0).stop 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.185+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 msgr2=0x7fb4681e1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.185+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 0x7fb4681e1130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb45800f780 tx=0x7fb45800fc40 comp rx=0 tx=0).stop 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 shutdown_connections 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb44c06a430 0x7fb44c06c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4681e1670 0x7fb468139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb46814b0b0 0x7fb4681e1130 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 --2- 172.21.15.6:0/4261190398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4540039a0 0x7fb4680b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 >> 172.21.15.6:0/4261190398 conn(0x7fb46806ae10 msgr2=0x7fb46813f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 shutdown_connections 2023-12-19T13:33:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.186+0000 7fb46f5c4640 1 -- 172.21.15.6:0/4261190398 wait complete. 2023-12-19T13:33:34.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T13:33:34.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:34.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T13:33:34.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-12-19T13:33:34.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:34.299 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T13:33:34.357 INFO:tasks.cephfs.cephfs_test_case:[] 2023-12-19T13:33:34.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.462+0000 7f26272b6640 1 Processor -- start 2023-12-19T13:33:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.462+0000 7f26272b6640 1 -- start start 2023-12-19T13:33:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f26272b6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26200b2ed0 0x7f2620070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f26272b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2620141680 0x7f2620141b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f26272b6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2620071c80 con 0x7f262006a390 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f26272b6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26201487f0 con 0x7f26200b2ed0 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f26272b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200715e0 con 0x7f2620141680 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26200b2ed0 0x7f2620070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26200b2ed0 0x7f2620070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44946/0 (socket says 172.21.15.6:44946) 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 -- 172.21.15.6:0/2017630354 learned_addr learned my addr 172.21.15.6:0/2017630354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2625052640 1 --1- 172.21.15.6:0/2017630354 >> v1:172.21.15.6:6789/0 conn(0x7f262006a390 0x7f26201480e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58760/0 (socket says 172.21.15.6:58760) 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2625853640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2620141680 0x7f2620141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 -- 172.21.15.6:0/2017630354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2620141680 msgr2=0x7f2620141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2620141680 0x7f2620141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 -- 172.21.15.6:0/2017630354 >> v1:172.21.15.6:6789/0 conn(0x7f262006a390 legacy=0x7f26201480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2624851640 1 -- 172.21.15.6:0/2017630354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200718c0 con 0x7f26200b2ed0 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.463+0000 7f2625853640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2620141680 0x7f2620141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f2624851640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26200b2ed0 0x7f2620070fc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2610009870 tx=0x7f261002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfb553e334911b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f2617fff640 1 -- 172.21.15.6:0/2017630354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261002f840 con 0x7f26200b2ed0 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f2617fff640 1 -- 172.21.15.6:0/2017630354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261002f9a0 con 0x7f26200b2ed0 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f2617fff640 1 -- 172.21.15.6:0/2017630354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261002fd30 con 0x7f26200b2ed0 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f26272b6640 1 -- 172.21.15.6:0/2017630354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26200b2ed0 msgr2=0x7f2620070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f26272b6640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26200b2ed0 0x7f2620070fc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2610009870 tx=0x7f261002ba20 comp rx=0 tx=0).stop 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f26272b6640 1 -- 172.21.15.6:0/2017630354 shutdown_connections 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f26272b6640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2620141680 0x7f2620141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f26272b6640 1 --2- 172.21.15.6:0/2017630354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26200b2ed0 0x7f2620070fc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.464+0000 7f26272b6640 1 -- 172.21.15.6:0/2017630354 >> 172.21.15.6:0/2017630354 conn(0x7f26200bc330 msgr2=0x7f26200bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.465+0000 7f26272b6640 1 -- 172.21.15.6:0/2017630354 shutdown_connections 2023-12-19T13:33:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.465+0000 7f26272b6640 1 -- 172.21.15.6:0/2017630354 wait complete. 2023-12-19T13:33:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 Processor -- start 2023-12-19T13:33:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 -- start start 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 0x7f26200b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2620141680 0x7f26200ba750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26200bac90 0x7f262013c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200bb380 con 0x7f262006a390 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200b6340 con 0x7f2620141680 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f26272b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200b7380 con 0x7f26200bac90 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f2625052640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 0x7f26200b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f2625052640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 0x7f26200b6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44950/0 (socket says 172.21.15.6:44950) 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.466+0000 7f2625052640 1 -- 172.21.15.6:0/475056279 learned_addr learned my addr 172.21.15.6:0/475056279 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2624851640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2620141680 0x7f26200ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625853640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26200bac90 0x7f262013c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625052640 1 -- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26200bac90 msgr2=0x7f262013c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625052640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26200bac90 0x7f262013c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625052640 1 -- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2620141680 msgr2=0x7f26200ba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625052640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2620141680 0x7f26200ba750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625052640 1 -- 172.21.15.6:0/475056279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100094d0 con 0x7f262006a390 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2625052640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 0x7f26200b6e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c4d0 tx=0x7f261c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c007480 con 0x7f262006a390 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c0075e0 con 0x7f262006a390 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26201d1440 con 0x7f262006a390 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c0049e0 con 0x7f262006a390 2023-12-19T13:33:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.467+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26200b59a0 con 0x7f262006a390 2023-12-19T13:33:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.468+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26200ba470 con 0x7f262006a390 2023-12-19T13:33:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.469+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f261c004b40 con 0x7f262006a390 2023-12-19T13:33:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.469+0000 7f2615ffb640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f260406a430 0x7f260406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.469+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f261c0878c0 con 0x7f262006a390 2023-12-19T13:33:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.469+0000 7f2624851640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f260406a430 0x7f260406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.470+0000 7f2624851640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f260406a430 0x7f260406c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2610036000 tx=0x7f2610039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.473+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f26200ba470 con 0x7f262006a390 2023-12-19T13:33:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.685+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26200ba470 con 0x7f262006a390 2023-12-19T13:33:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.685+0000 7f2615ffb640 1 -- 172.21.15.6:0/475056279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f26200ba470 con 0x7f262006a390 2023-12-19T13:33:34.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:34.687 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f260406a430 msgr2=0x7f260406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f260406a430 0x7f260406c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2610036000 tx=0x7f2610039040 comp rx=0 tx=0).stop 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 msgr2=0x7f26200b6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 0x7f26200b6e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c4d0 tx=0x7f261c00c990 comp rx=0 tx=0).stop 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 shutdown_connections 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f260406a430 0x7f260406c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26200bac90 0x7f262013c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2620141680 0x7f26200ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 --2- 172.21.15.6:0/475056279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262006a390 0x7f26200b6e40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 >> 172.21.15.6:0/475056279 conn(0x7f26200bc330 msgr2=0x7f262013e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:34.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 shutdown_connections 2023-12-19T13:33:34.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.687+0000 7f26272b6640 1 -- 172.21.15.6:0/475056279 wait complete. 2023-12-19T13:33:34.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:34.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.805+0000 7f6f9a1e0640 1 Processor -- start 2023-12-19T13:33:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.805+0000 7f6f9a1e0640 1 -- start start 2023-12-19T13:33:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f9a1e0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f9406a6d0 0x7f6f9414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f9a1e0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f940ba550 0x7f6f941554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f9a1e0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940bb310 con 0x7f6f9414b1f0 2023-12-19T13:33:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f9a1e0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940bf960 con 0x7f6f940ba550 2023-12-19T13:33:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f9a1e0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940bb5b0 con 0x7f6f9406a6d0 2023-12-19T13:33:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f940ba550 0x7f6f941554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f940ba550 0x7f6f941554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44956/0 (socket says 172.21.15.6:44956) 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 -- 172.21.15.6:0/2830389017 learned_addr learned my addr 172.21.15.6:0/2830389017 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 -- 172.21.15.6:0/2830389017 >> v2:172.21.15.89:3300/0 conn(0x7f6f9406a6d0 msgr2=0x7f6f9414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 --2- 172.21.15.6:0/2830389017 >> v2:172.21.15.89:3300/0 conn(0x7f6f9406a6d0 0x7f6f9414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 -- 172.21.15.6:0/2830389017 >> v1:172.21.15.89:6789/0 conn(0x7f6f9414b1f0 legacy=0x7f6f940b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.806+0000 7f6f93fff640 1 -- 172.21.15.6:0/2830389017 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940c0120 con 0x7f6f940ba550 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.807+0000 7f6f93fff640 1 --2- 172.21.15.6:0/2830389017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f940ba550 0x7f6f941554e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f9408a260 tx=0x7f6f8c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0e96251d0d5945 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.807+0000 7f6f927fc640 1 -- 172.21.15.6:0/2830389017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c02ca80 con 0x7f6f940ba550 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.807+0000 7f6f927fc640 1 -- 172.21.15.6:0/2830389017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c02cbe0 con 0x7f6f940ba550 2023-12-19T13:33:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.807+0000 7f6f927fc640 1 -- 172.21.15.6:0/2830389017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0343f0 con 0x7f6f940ba550 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/2830389017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f940ba550 msgr2=0x7f6f941554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/2830389017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f940ba550 0x7f6f941554e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f9408a260 tx=0x7f6f8c02bee0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/2830389017 shutdown_connections 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/2830389017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f940ba550 0x7f6f941554e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/2830389017 >> v2:172.21.15.89:3300/0 conn(0x7f6f9406a6d0 0x7f6f9414acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/2830389017 >> 172.21.15.6:0/2830389017 conn(0x7f6f940c0350 msgr2=0x7f6f940c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/2830389017 shutdown_connections 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.808+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/2830389017 wait complete. 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.809+0000 7f6f9a1e0640 1 Processor -- start 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.809+0000 7f6f9a1e0640 1 -- start start 2023-12-19T13:33:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f9a1e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 0x7f6f94146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f9a1e0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f940ba550 0x7f6f940a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f9a1e0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f9414b1f0 0x7f6f941e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f9a1e0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940a5ed0 con 0x7f6f9406a6d0 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f9a1e0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94144b30 con 0x7f6f9414b1f0 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f9a1e0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941e30b0 con 0x7f6f940ba550 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 0x7f6f94146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 0x7f6f94146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44966/0 (socket says 172.21.15.6:44966) 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 -- 172.21.15.6:0/3995935383 learned_addr learned my addr 172.21.15.6:0/3995935383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f93fff640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f9414b1f0 0x7f6f941e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f92ffd640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f940ba550 0x7f6f940a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 -- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f940ba550 msgr2=0x7f6f940a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f940ba550 0x7f6f940a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 -- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f9414b1f0 msgr2=0x7f6f941e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f9414b1f0 0x7f6f941e3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 -- 172.21.15.6:0/3995935383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c009b30 con 0x7f6f9406a6d0 2023-12-19T13:33:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f93fff640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f9414b1f0 0x7f6f941e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.810+0000 7f6f937fe640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 0x7f6f94146940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400b4a0 tx=0x7f6f8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.811+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84010610 con 0x7f6f9406a6d0 2023-12-19T13:33:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.811+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84010770 con 0x7f6f9406a6d0 2023-12-19T13:33:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.811+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84010b20 con 0x7f6f9406a6d0 2023-12-19T13:33:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.811+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f94147aa0 con 0x7f6f9406a6d0 2023-12-19T13:33:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.811+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f940a1ad0 con 0x7f6f9406a6d0 2023-12-19T13:33:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.812+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f94073a40 con 0x7f6f9406a6d0 2023-12-19T13:33:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.812+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6f84010c80 con 0x7f6f9406a6d0 2023-12-19T13:33:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.813+0000 7f6f7bfff640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6f8006a430 0x7f6f8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.813+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f840883e0 con 0x7f6f9406a6d0 2023-12-19T13:33:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.813+0000 7f6f92ffd640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6f8006a430 0x7f6f8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.813+0000 7f6f92ffd640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6f8006a430 0x7f6f8006c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f941dd6d0 tx=0x7f6f88009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:34.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.817+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6f84053b10 con 0x7f6f9406a6d0 2023-12-19T13:33:34.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.993+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f940a62d0 con 0x7f6f9406a6d0 2023-12-19T13:33:34.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.994+0000 7f6f7bfff640 1 -- 172.21.15.6:0/3995935383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f6f84057130 con 0x7f6f9406a6d0 2023-12-19T13:33:34.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:34.997 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:34.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6f8006a430 msgr2=0x7f6f8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6f8006a430 0x7f6f8006c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f941dd6d0 tx=0x7f6f88009060 comp rx=0 tx=0).stop 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 msgr2=0x7f6f94146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 0x7f6f94146940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400b4a0 tx=0x7f6f8400b960 comp rx=0 tx=0).stop 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 shutdown_connections 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f6f8006a430 0x7f6f8006c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f9414b1f0 0x7f6f941e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f940ba550 0x7f6f940a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 --2- 172.21.15.6:0/3995935383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9406a6d0 0x7f6f94146940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 >> 172.21.15.6:0/3995935383 conn(0x7f6f940c0350 msgr2=0x7f6f940be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:34.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 shutdown_connections 2023-12-19T13:33:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:34.996+0000 7f6f9a1e0640 1 -- 172.21.15.6:0/3995935383 wait complete. 2023-12-19T13:33:35.009 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:06.103734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:07.005290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:35.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.116+0000 7f441130a640 1 Processor -- start 2023-12-19T13:33:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.116+0000 7f441130a640 1 -- start start 2023-12-19T13:33:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f441130a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f440c0b8690 0x7f440c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f441130a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f440c0b77d0 0x7f440c144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f441130a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440c14ab10 con 0x7f440c144bb0 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f441130a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440c145020 con 0x7f440c0b77d0 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f441130a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440c06c2f0 con 0x7f440c0b8690 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f440c0b77d0 0x7f440c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f440c0b77d0 0x7f440c144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44974/0 (socket says 172.21.15.6:44974) 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 -- 172.21.15.6:0/679513119 learned_addr learned my addr 172.21.15.6:0/679513119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440affd640 1 --2- 172.21.15.6:0/679513119 >> v2:172.21.15.89:3300/0 conn(0x7f440c0b8690 0x7f440c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 -- 172.21.15.6:0/679513119 >> v2:172.21.15.89:3300/0 conn(0x7f440c0b8690 msgr2=0x7f440c0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 --2- 172.21.15.6:0/679513119 >> v2:172.21.15.89:3300/0 conn(0x7f440c0b8690 0x7f440c0b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 -- 172.21.15.6:0/679513119 >> v1:172.21.15.89:6789/0 conn(0x7f440c144bb0 legacy=0x7f440c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.117+0000 7f440a7fc640 1 -- 172.21.15.6:0/679513119 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0ba620 con 0x7f440c0b77d0 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.118+0000 7f440a7fc640 1 --2- 172.21.15.6:0/679513119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c144670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f440c06aca0 tx=0x7f440002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aab6a700d40c53 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.118+0000 7f4409ffb640 1 -- 172.21.15.6:0/679513119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44000317e0 con 0x7f440c0b77d0 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.118+0000 7f4409ffb640 1 -- 172.21.15.6:0/679513119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400031940 con 0x7f440c0b77d0 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.118+0000 7f4409ffb640 1 -- 172.21.15.6:0/679513119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400031cd0 con 0x7f440c0b77d0 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 -- 172.21.15.6:0/679513119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 msgr2=0x7f440c144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 --2- 172.21.15.6:0/679513119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c144670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f440c06aca0 tx=0x7f440002b880 comp rx=0 tx=0).stop 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 -- 172.21.15.6:0/679513119 shutdown_connections 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 --2- 172.21.15.6:0/679513119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c144670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 --2- 172.21.15.6:0/679513119 >> v2:172.21.15.89:3300/0 conn(0x7f440c0b8690 0x7f440c0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 -- 172.21.15.6:0/679513119 >> 172.21.15.6:0/679513119 conn(0x7f440c06b6a0 msgr2=0x7f440c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 -- 172.21.15.6:0/679513119 shutdown_connections 2023-12-19T13:33:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.119+0000 7f441130a640 1 -- 172.21.15.6:0/679513119 wait complete. 2023-12-19T13:33:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.120+0000 7f441130a640 1 Processor -- start 2023-12-19T13:33:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.120+0000 7f441130a640 1 -- start start 2023-12-19T13:33:35.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c13c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f440c0b8690 0x7f440c145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f440c144bb0 0x7f440c1e3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c145160 con 0x7f440c0b77d0 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c13c960 con 0x7f440c144bb0 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c13d150 con 0x7f440c0b8690 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c13c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c13c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44976/0 (socket says 172.21.15.6:44976) 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 -- 172.21.15.6:0/1372827125 learned_addr learned my addr 172.21.15.6:0/1372827125 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440b7fe640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f440c144bb0 0x7f440c1e3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440a7fc640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f440c0b8690 0x7f440c145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 -- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f440c0b8690 msgr2=0x7f440c145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f440c0b8690 0x7f440c145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 -- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f440c144bb0 msgr2=0x7f440c1e3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f440c144bb0 0x7f440c1e3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 -- 172.21.15.6:0/1372827125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000094d0 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440a7fc640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f440c0b8690 0x7f440c145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f440affd640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c13c420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f440400c7f0 tx=0x7f440400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404004220 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44040043a0 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c146440 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404007860 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.121+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c145340 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.122+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440c04e080 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.123+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4404007bd0 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.123+0000 7f43f37fe640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43f806a430 0x7f43f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.123+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4404088830 con 0x7f440c0b77d0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.123+0000 7f440a7fc640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43f806a430 0x7f43f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.124+0000 7f440a7fc640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43f806a430 0x7f43f806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4400036000 tx=0x7f440003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.127+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4404053ee0 con 0x7f440c0b77d0 2023-12-19T13:33:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.300+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f440c073a40 con 0x7f440c0b77d0 2023-12-19T13:33:35.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.301+0000 7f43f37fe640 1 -- 172.21.15.6:0/1372827125 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4404057500 con 0x7f440c0b77d0 2023-12-19T13:33:35.303 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43f806a430 msgr2=0x7f43f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43f806a430 0x7f43f806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4400036000 tx=0x7f440003d040 comp rx=0 tx=0).stop 2023-12-19T13:33:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 msgr2=0x7f440c13c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c13c420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f440400c7f0 tx=0x7f440400ccb0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 shutdown_connections 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43f806a430 0x7f43f806c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f440c144bb0 0x7f440c1e3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f440c0b8690 0x7f440c145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 --2- 172.21.15.6:0/1372827125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0b77d0 0x7f440c13c420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 >> 172.21.15.6:0/1372827125 conn(0x7f440c06b6a0 msgr2=0x7f440c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 shutdown_connections 2023-12-19T13:33:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.303+0000 7f441130a640 1 -- 172.21.15.6:0/1372827125 wait complete. 2023-12-19T13:33:35.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T13:33:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e1d3c9640 1 Processor -- start 2023-12-19T13:33:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e1d3c9640 1 -- start start 2023-12-19T13:33:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e1d3c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e1806adf0 0x7f3e1814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e1d3c9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1814e040 con 0x7f3e181416b0 2023-12-19T13:33:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e1d3c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180bb5d0 con 0x7f3e180b5000 2023-12-19T13:33:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e1d3c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1806b3a0 con 0x7f3e1806adf0 2023-12-19T13:33:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e16ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3e181416b0 0x7f3e180baec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58766/0 (socket says 172.21.15.6:58766) 2023-12-19T13:33:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.422+0000 7f3e16ffd640 1 -- 172.21.15.6:0/3805514297 learned_addr learned my addr 172.21.15.6:0/3805514297 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e167fc640 1 --2- 172.21.15.6:0/3805514297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e1806adf0 0x7f3e1814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609728847 0 0) 0x7f3e1814e040 con 0x7f3e181416b0 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e00003520 con 0x7f3e181416b0 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896704620 0 0) 0x7f3e180bb5d0 con 0x7f3e180b5000 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e1814e040 con 0x7f3e180b5000 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e167fc640 1 -- 172.21.15.6:0/3805514297 >> v1:172.21.15.89:6789/0 conn(0x7f3e180b5000 legacy=0x7f3e181553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e167fc640 1 -- 172.21.15.6:0/3805514297 >> v1:172.21.15.6:6789/0 conn(0x7f3e181416b0 legacy=0x7f3e180baec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 885850463 0 0) 0x7f3e00003520 con 0x7f3e181416b0 2023-12-19T13:33:35.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.423+0000 7f3e167fc640 1 -- 172.21.15.6:0/3805514297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1806b680 con 0x7f3e1806adf0 2023-12-19T13:33:35.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.424+0000 7f3e167fc640 1 --2- 172.21.15.6:0/3805514297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e1806adf0 0x7f3e1814e4d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097d0 tx=0x7f3e0c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d568a7ec3ffdc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.424+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08001670 con 0x7f3e1806adf0 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.424+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c02e050 con 0x7f3e1806adf0 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.424+0000 7f3e15ffb640 1 -- 172.21.15.6:0/3805514297 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c030730 con 0x7f3e1806adf0 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.424+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/3805514297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e1806adf0 msgr2=0x7f3e1814e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.424+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/3805514297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e1806adf0 0x7f3e1814e4d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0097d0 tx=0x7f3e0c02b800 comp rx=0 tx=0).stop 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.425+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/3805514297 shutdown_connections 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.425+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/3805514297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e1806adf0 0x7f3e1814e4d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.425+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/3805514297 >> 172.21.15.6:0/3805514297 conn(0x7f3e18069ee0 msgr2=0x7f3e1806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.425+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/3805514297 shutdown_connections 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.425+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/3805514297 wait complete. 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 Processor -- start 2023-12-19T13:33:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 -- start start 2023-12-19T13:33:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 0x7f3e180b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e180b5000 0x7f3e18145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e181416b0 0x7f3e18147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181454e0 con 0x7f3e1806adf0 2023-12-19T13:33:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180b7620 con 0x7f3e181416b0 2023-12-19T13:33:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.426+0000 7f3e1d3c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180bd510 con 0x7f3e180b5000 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 0x7f3e180b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 0x7f3e180b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44988/0 (socket says 172.21.15.6:44988) 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 -- 172.21.15.6:0/2557291881 learned_addr learned my addr 172.21.15.6:0/2557291881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e167fc640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e180b5000 0x7f3e18145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e177fe640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e181416b0 0x7f3e18147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 -- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e180b5000 msgr2=0x7f3e18145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e180b5000 0x7f3e18145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 -- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e181416b0 msgr2=0x7f3e18147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e181416b0 0x7f3e18147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 -- 172.21.15.6:0/2557291881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009400 con 0x7f3e1806adf0 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e167fc640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e180b5000 0x7f3e18145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e16ffd640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 0x7f3e180b70e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c780 tx=0x7f3e0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08005ad0 con 0x7f3e1806adf0 2023-12-19T13:33:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e08005c30 con 0x7f3e1806adf0 2023-12-19T13:33:35.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1814b920 con 0x7f3e1806adf0 2023-12-19T13:33:35.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08007070 con 0x7f3e1806adf0 2023-12-19T13:33:35.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.427+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18147d30 con 0x7f3e1806adf0 2023-12-19T13:33:35.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.428+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1806be10 con 0x7f3e1806adf0 2023-12-19T13:33:35.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.429+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e080071d0 con 0x7f3e1806adf0 2023-12-19T13:33:35.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.429+0000 7f3dff7fe640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3e0406a400 0x7f3e0406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.429+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e08087f90 con 0x7f3e1806adf0 2023-12-19T13:33:35.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.429+0000 7f3e167fc640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3e0406a400 0x7f3e0406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.430+0000 7f3e167fc640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3e0406a400 0x7f3e0406c8c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c034000 tx=0x7f3e0c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.433+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e080bac80 con 0x7f3e1806adf0 2023-12-19T13:33:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.610+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e18073a40 con 0x7f3e1806adf0 2023-12-19T13:33:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.610+0000 7f3dff7fe640 1 -- 172.21.15.6:0/2557291881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e08017020 con 0x7f3e1806adf0 2023-12-19T13:33:35.612 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3e0406a400 msgr2=0x7f3e0406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3e0406a400 0x7f3e0406c8c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c034000 tx=0x7f3e0c008030 comp rx=0 tx=0).stop 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 msgr2=0x7f3e180b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 0x7f3e180b70e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c780 tx=0x7f3e0800cc40 comp rx=0 tx=0).stop 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 shutdown_connections 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3e0406a400 0x7f3e0406c8c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e181416b0 0x7f3e18147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e180b5000 0x7f3e18145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 --2- 172.21.15.6:0/2557291881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1806adf0 0x7f3e180b70e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 >> 172.21.15.6:0/2557291881 conn(0x7f3e18069ee0 msgr2=0x7f3e180bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 shutdown_connections 2023-12-19T13:33:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.612+0000 7f3e1d3c9640 1 -- 172.21.15.6:0/2557291881 wait complete. 2023-12-19T13:33:35.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T13:33:35.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.731+0000 7fef3337d640 1 Processor -- start 2023-12-19T13:33:35.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef3337d640 1 -- start start 2023-12-19T13:33:35.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef3337d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef2c0b8690 0x7fef2c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef3337d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef3337d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c14ab10 con 0x7fef2c144bb0 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef3337d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c06c2f0 con 0x7fef2c0b8690 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef3337d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0ba620 con 0x7fef2c0b77d0 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef31119640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef2c0b8690 0x7fef2c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.732+0000 7fef31119640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef2c0b8690 0x7fef2c0b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44992/0 (socket says 172.21.15.6:44992) 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef31119640 1 -- 172.21.15.6:0/1546220744 learned_addr learned my addr 172.21.15.6:0/1546220744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef30918640 1 --2- 172.21.15.6:0/1546220744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef31119640 1 -- 172.21.15.6:0/1546220744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 msgr2=0x7fef2c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef31119640 1 --2- 172.21.15.6:0/1546220744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef31119640 1 -- 172.21.15.6:0/1546220744 >> v1:172.21.15.89:6789/0 conn(0x7fef2c144bb0 legacy=0x7fef2c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:35.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef31119640 1 -- 172.21.15.6:0/1546220744 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0b9e60 con 0x7fef2c0b8690 2023-12-19T13:33:35.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.733+0000 7fef31119640 1 --2- 172.21.15.6:0/1546220744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c0b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fef28009870 tx=0x7fef2802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a435da2d0638cda3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef23fff640 1 -- 172.21.15.6:0/1546220744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef280317c0 con 0x7fef2c0b8690 2023-12-19T13:33:35.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef23fff640 1 -- 172.21.15.6:0/1546220744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef28031920 con 0x7fef2c0b8690 2023-12-19T13:33:35.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef23fff640 1 -- 172.21.15.6:0/1546220744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28031cb0 con 0x7fef2c0b8690 2023-12-19T13:33:35.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 -- 172.21.15.6:0/1546220744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 msgr2=0x7fef2c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 --2- 172.21.15.6:0/1546220744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c0b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fef28009870 tx=0x7fef2802b860 comp rx=0 tx=0).stop 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 -- 172.21.15.6:0/1546220744 shutdown_connections 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 --2- 172.21.15.6:0/1546220744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 --2- 172.21.15.6:0/1546220744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c0b8a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 -- 172.21.15.6:0/1546220744 >> 172.21.15.6:0/1546220744 conn(0x7fef2c06b6a0 msgr2=0x7fef2c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 -- 172.21.15.6:0/1546220744 shutdown_connections 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.734+0000 7fef3337d640 1 -- 172.21.15.6:0/1546220744 wait complete. 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.735+0000 7fef3337d640 1 Processor -- start 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.735+0000 7fef3337d640 1 -- start start 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3337d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3337d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3337d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c144bb0 0x7fef2c145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3337d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c14a490 con 0x7fef2c0b8690 2023-12-19T13:33:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3337d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1457a0 con 0x7fef2c144bb0 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3337d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c136740 con 0x7fef2c0b77d0 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44998/0 (socket says 172.21.15.6:44998) 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 -- 172.21.15.6:0/2026265394 learned_addr learned my addr 172.21.15.6:0/2026265394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef31119640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3191a640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c144bb0 0x7fef2c145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 -- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 msgr2=0x7fef2c137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 -- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c144bb0 msgr2=0x7fef2c145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c144bb0 0x7fef2c145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 -- 172.21.15.6:0/2026265394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280094d0 con 0x7fef2c0b8690 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef3191a640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c144bb0 0x7fef2c145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.736+0000 7fef30918640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c149f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c7f0 tx=0x7fef1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.737+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c004220 con 0x7fef2c0b8690 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.737+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c0043a0 con 0x7fef2c0b8690 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.737+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c136a20 con 0x7fef2c0b8690 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.737+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c003850 con 0x7fef2c0b8690 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.737+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c136db0 con 0x7fef2c0b8690 2023-12-19T13:33:35.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.738+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c136f40 con 0x7fef2c0b8690 2023-12-19T13:33:35.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.738+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef1c003bc0 con 0x7fef2c0b8690 2023-12-19T13:33:35.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.739+0000 7fef21ffb640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef1006a430 0x7fef1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:35.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.739+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef1c088790 con 0x7fef2c0b8690 2023-12-19T13:33:35.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.739+0000 7fef31119640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef1006a430 0x7fef1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:35.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.739+0000 7fef31119640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef1006a430 0x7fef1006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef28036000 tx=0x7fef2803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:35.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.743+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef2c136f40 con 0x7fef2c0b8690 2023-12-19T13:33:35.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.919+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef2c136f40 con 0x7fef2c0b8690 2023-12-19T13:33:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.920+0000 7fef21ffb640 1 -- 172.21.15.6:0/2026265394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef2c136f40 con 0x7fef2c0b8690 2023-12-19T13:33:35.922 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef1006a430 msgr2=0x7fef1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef1006a430 0x7fef1006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef28036000 tx=0x7fef2803d040 comp rx=0 tx=0).stop 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 msgr2=0x7fef2c149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c149f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c7f0 tx=0x7fef1c00ccb0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 shutdown_connections 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef1006a430 0x7fef1006c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c144bb0 0x7fef2c145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c0b8690 0x7fef2c149f50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 --2- 172.21.15.6:0/2026265394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef2c0b77d0 0x7fef2c137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:35.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 >> 172.21.15.6:0/2026265394 conn(0x7fef2c06b6a0 msgr2=0x7fef2c0bb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:35.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 shutdown_connections 2023-12-19T13:33:35.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:35.922+0000 7fef3337d640 1 -- 172.21.15.6:0/2026265394 wait complete. 2023-12-19T13:33:35.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:36.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.038+0000 7f39caa4b640 1 Processor -- start 2023-12-19T13:33:36.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.038+0000 7f39caa4b640 1 -- start start 2023-12-19T13:33:36.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39caa4b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4144ea0 0x7f39c40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39caa4b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c406a410 con 0x7f39c40708b0 2023-12-19T13:33:36.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39caa4b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c40b4110 con 0x7f39c4071ab0 2023-12-19T13:33:36.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39caa4b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c414ad20 con 0x7f39c4144ea0 2023-12-19T13:33:36.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39c8fe8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39c40708b0 0x7f39c41554b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58772/0 (socket says 172.21.15.6:58772) 2023-12-19T13:33:36.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39c8fe8640 1 -- 172.21.15.6:0/2879069824 learned_addr learned my addr 172.21.15.6:0/2879069824 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39c3fff640 1 --2- 172.21.15.6:0/2879069824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4144ea0 0x7f39c40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749539056 0 0) 0x7f39c406a410 con 0x7f39c40708b0 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.039+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39ac003520 con 0x7f39c40708b0 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.040+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401012510 0 0) 0x7f39c40b4110 con 0x7f39c4071ab0 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.040+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c406a410 con 0x7f39c4071ab0 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.040+0000 7f39c3fff640 1 -- 172.21.15.6:0/2879069824 >> v1:172.21.15.89:6789/0 conn(0x7f39c4071ab0 legacy=0x7f39c4069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.040+0000 7f39c3fff640 1 -- 172.21.15.6:0/2879069824 >> v1:172.21.15.6:6789/0 conn(0x7f39c40708b0 legacy=0x7f39c41554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.040+0000 7f39c3fff640 1 -- 172.21.15.6:0/2879069824 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c414b000 con 0x7f39c4144ea0 2023-12-19T13:33:36.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.040+0000 7f39c3fff640 1 --2- 172.21.15.6:0/2879069824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4144ea0 0x7f39c40b3bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39b80097d0 tx=0x7f39b802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68388c8a904532af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8030880 con 0x7f39c4144ea0 2023-12-19T13:33:36.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b80309e0 con 0x7f39c4144ea0 2023-12-19T13:33:36.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39c2ffd640 1 -- 172.21.15.6:0/2879069824 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8030d70 con 0x7f39c4144ea0 2023-12-19T13:33:36.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 -- 172.21.15.6:0/2879069824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4144ea0 msgr2=0x7f39c40b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 --2- 172.21.15.6:0/2879069824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4144ea0 0x7f39c40b3bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39b80097d0 tx=0x7f39b802b9c0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 -- 172.21.15.6:0/2879069824 shutdown_connections 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 --2- 172.21.15.6:0/2879069824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4144ea0 0x7f39c40b3bd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 -- 172.21.15.6:0/2879069824 >> 172.21.15.6:0/2879069824 conn(0x7f39c40bd240 msgr2=0x7f39c40bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 -- 172.21.15.6:0/2879069824 shutdown_connections 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.041+0000 7f39caa4b640 1 -- 172.21.15.6:0/2879069824 wait complete. 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.042+0000 7f39caa4b640 1 Processor -- start 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.042+0000 7f39caa4b640 1 -- start start 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39caa4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c40708b0 0x7f39c41d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39caa4b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4071ab0 0x7f39c41d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39caa4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 0x7f39c4148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39caa4b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40b3b40 con 0x7f39c4144ea0 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39caa4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4147460 con 0x7f39c40708b0 2023-12-19T13:33:36.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39caa4b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4148380 con 0x7f39c4071ab0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 0x7f39c4148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 0x7f39c4148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45002/0 (socket says 172.21.15.6:45002) 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 -- 172.21.15.6:0/4167567906 learned_addr learned my addr 172.21.15.6:0/4167567906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c37fe640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4071ab0 0x7f39c41d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c3fff640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c40708b0 0x7f39c41d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 -- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4071ab0 msgr2=0x7f39c41d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4071ab0 0x7f39c41d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 -- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c40708b0 msgr2=0x7f39c41d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c40708b0 0x7f39c41d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.043+0000 7f39c8fe8640 1 -- 172.21.15.6:0/4167567906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009400 con 0x7f39c4144ea0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.044+0000 7f39c8fe8640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 0x7f39c4148810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00cba0 tx=0x7f39bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.044+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00ace0 con 0x7f39c4144ea0 2023-12-19T13:33:36.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.044+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc00ae40 con 0x7f39c4144ea0 2023-12-19T13:33:36.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.044+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc012620 con 0x7f39c4144ea0 2023-12-19T13:33:36.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.044+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c41d2890 con 0x7f39c4144ea0 2023-12-19T13:33:36.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.044+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c41d1610 con 0x7f39c4144ea0 2023-12-19T13:33:36.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.045+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c4148150 con 0x7f39c4144ea0 2023-12-19T13:33:36.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.045+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39bc007070 con 0x7f39c4144ea0 2023-12-19T13:33:36.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.046+0000 7f39c0ff9640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f39b006a430 0x7f39b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.046+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39bc088820 con 0x7f39c4144ea0 2023-12-19T13:33:36.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.046+0000 7f39c3fff640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f39b006a430 0x7f39b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.046+0000 7f39c3fff640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f39b006a430 0x7f39b006c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f39b8036000 tx=0x7f39b803b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.050+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39c4148150 con 0x7f39c4144ea0 2023-12-19T13:33:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.264+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39c4148150 con 0x7f39c4144ea0 2023-12-19T13:33:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.264+0000 7f39c0ff9640 1 -- 172.21.15.6:0/4167567906 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f39c4148150 con 0x7f39c4144ea0 2023-12-19T13:33:36.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:36.267 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:36.267 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f39b006a430 msgr2=0x7f39b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f39b006a430 0x7f39b006c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f39b8036000 tx=0x7f39b803b040 comp rx=0 tx=0).stop 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 msgr2=0x7f39c4148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 0x7f39c4148810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00cba0 tx=0x7f39bc00a430 comp rx=0 tx=0).stop 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 shutdown_connections 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f39b006a430 0x7f39b006c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39c4144ea0 0x7f39c4148810 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c4071ab0 0x7f39c41d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 --2- 172.21.15.6:0/4167567906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c40708b0 0x7f39c41d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 >> 172.21.15.6:0/4167567906 conn(0x7f39c40bd240 msgr2=0x7f39c40b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 shutdown_connections 2023-12-19T13:33:36.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.266+0000 7f39caa4b640 1 -- 172.21.15.6:0/4167567906 wait complete. 2023-12-19T13:33:36.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.382+0000 7f0ee0718640 1 Processor -- start 2023-12-19T13:33:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.382+0000 7f0ee0718640 1 -- start start 2023-12-19T13:33:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0ee0718640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ed81544e0 0x7f0ed81568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0ee0718640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed80bb310 con 0x7f0ed80ba550 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0ee0718640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed80bf960 con 0x7f0ed806a6d0 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0ee0718640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed80bb5b0 con 0x7f0ed81544e0 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0eddcb3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0ed80ba550 0x7f0ed80b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58786/0 (socket says 172.21.15.6:58786) 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0eddcb3640 1 -- 172.21.15.6:0/4081825786 learned_addr learned my addr 172.21.15.6:0/4081825786 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0edecb5640 1 --2- 172.21.15.6:0/4081825786 >> v2:172.21.15.89:3300/0 conn(0x7f0ed81544e0 0x7f0ed81568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715754989 0 0) 0x7f0ed80bb310 con 0x7f0ed80ba550 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.383+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4003520 con 0x7f0ed80ba550 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3890808207 0 0) 0x7f0ec4003520 con 0x7f0ed80ba550 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 >> v2:172.21.15.89:3300/0 conn(0x7f0ed81544e0 msgr2=0x7f0ed81568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 --2- 172.21.15.6:0/4081825786 >> v2:172.21.15.89:3300/0 conn(0x7f0ed81544e0 0x7f0ed81568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 >> v1:172.21.15.89:6789/0 conn(0x7f0ed806a6d0 legacy=0x7f0ed814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80c0120 con 0x7f0ed80ba550 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f0ec8001670 con 0x7f0ed80ba550 2023-12-19T13:33:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 >> v1:172.21.15.6:6789/0 conn(0x7f0ed80ba550 legacy=0x7f0ed80b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ec4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec4004370 0x7f0ec4004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ec4005040 0x7f0ec400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80bb5b0 con 0x7f0ec4003970 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec400bfa0 con 0x7f0ec4004370 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec400c160 con 0x7f0ec4005040 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ec4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0eddcb3640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec4004370 0x7f0ec4004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edecb5640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ec4005040 0x7f0ec400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0ede4b4640 1 -- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ec4005040 msgr2=0x7f0ec400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ec4005040 0x7f0ec400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0ede4b4640 1 -- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec4004370 msgr2=0x7f0ec4004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec4004370 0x7f0ec4004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0ede4b4640 1 -- 172.21.15.6:0/4081825786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4003520 con 0x7f0ec4003970 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edecb5640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ec4005040 0x7f0ec400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.384+0000 7f0edecb5640 1 -- 172.21.15.6:0/4081825786 reap_dead start 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.385+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ec4003d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0001860 tx=0x7f0ec40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985f4eefd0f40937 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.385+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0033410 con 0x7f0ec4003970 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.385+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0033590 con 0x7f0ec4003970 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.385+0000 7f0edd4b2640 1 -- 172.21.15.6:0/4081825786 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0033940 con 0x7f0ec4003970 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.385+0000 7f0ee0718640 1 -- 172.21.15.6:0/4081825786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 msgr2=0x7f0ec4003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.385+0000 7f0ee0718640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ec4003d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0001860 tx=0x7f0ec40057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.386+0000 7f0ee0718640 1 -- 172.21.15.6:0/4081825786 shutdown_connections 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.386+0000 7f0ee0718640 1 --2- 172.21.15.6:0/4081825786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ec4003d50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.386+0000 7f0ee0718640 1 -- 172.21.15.6:0/4081825786 >> 172.21.15.6:0/4081825786 conn(0x7f0ed80c0350 msgr2=0x7f0ed80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.386+0000 7f0ee0718640 1 -- 172.21.15.6:0/4081825786 shutdown_connections 2023-12-19T13:33:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.386+0000 7f0ee0718640 1 -- 172.21.15.6:0/4081825786 wait complete. 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 Processor -- start 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 -- start start 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ed814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ed80b6c50 0x7f0ed80a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ed80a32a0 0x7f0ed8144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80a60f0 con 0x7f0ec4003970 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed814c6d0 con 0x7f0ed80b6c50 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ee0718640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81dfc00 con 0x7f0ed80a32a0 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ede4b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ed814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ede4b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ed814bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45026/0 (socket says 172.21.15.6:45026) 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0ede4b4640 1 -- 172.21.15.6:0/278490342 learned_addr learned my addr 172.21.15.6:0/278490342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.387+0000 7f0edecb5640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ed80a32a0 0x7f0ed8144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0eddcb3640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ed80b6c50 0x7f0ed80a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ede4b4640 1 -- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ed80a32a0 msgr2=0x7f0ed8144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ed80a32a0 0x7f0ed8144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ede4b4640 1 -- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ed80b6c50 msgr2=0x7f0ed80a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ed80b6c50 0x7f0ed80a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ede4b4640 1 -- 172.21.15.6:0/278490342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed81dfee0 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ede4b4640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ed814bda0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ed002bd00 tx=0x7f0ed0001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0007320 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0007480 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed81e01c0 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00067d0 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.388+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed81df8d0 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.389+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed80bfbe0 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.389+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ed003a070 con 0x7f0ec4003970 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.390+0000 7f0eceffd640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0ebc06a430 0x7f0ebc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.390+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ed00a9c70 con 0x7f0ec4003970 2023-12-19T13:33:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.390+0000 7f0eddcb3640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0ebc06a430 0x7f0ebc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.390+0000 7f0eddcb3640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0ebc06a430 0x7f0ebc06c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80a5300 tx=0x7f0ec8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.394+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ed80bfbe0 con 0x7f0ec4003970 2023-12-19T13:33:36.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.569+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed80bfbe0 con 0x7f0ec4003970 2023-12-19T13:33:36.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.570+0000 7f0eceffd640 1 -- 172.21.15.6:0/278490342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f0ed80bfbe0 con 0x7f0ec4003970 2023-12-19T13:33:36.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:36.572 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0ebc06a430 msgr2=0x7f0ebc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0ebc06a430 0x7f0ebc06c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80a5300 tx=0x7f0ec8009040 comp rx=0 tx=0).stop 2023-12-19T13:33:36.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 msgr2=0x7f0ed814bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ed814bda0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ed002bd00 tx=0x7f0ed0001230 comp rx=0 tx=0).stop 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 shutdown_connections 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0ebc06a430 0x7f0ebc06c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ed80a32a0 0x7f0ed8144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ed80b6c50 0x7f0ed80a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 --2- 172.21.15.6:0/278490342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec4003970 0x7f0ed814bda0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 >> 172.21.15.6:0/278490342 conn(0x7f0ed80c0350 msgr2=0x7f0ed80b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 shutdown_connections 2023-12-19T13:33:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.572+0000 7f0ee0718640 1 -- 172.21.15.6:0/278490342 wait complete. 2023-12-19T13:33:36.585 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T13:33:36.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.688+0000 7fefa7f47640 1 Processor -- start 2023-12-19T13:33:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.689+0000 7fefa7f47640 1 -- start start 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.689+0000 7fefa7f47640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 0x7fefa014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.689+0000 7fefa7f47640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fefa00ba550 0x7fefa01554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.689+0000 7fefa7f47640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa00bb310 con 0x7fefa014b1f0 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.689+0000 7fefa7f47640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa00bf960 con 0x7fefa00ba550 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.689+0000 7fefa7f47640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00bb5b0 con 0x7fefa006a6d0 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa5ce3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 0x7fefa014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa64e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fefa00ba550 0x7fefa01554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa5ce3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 0x7fefa014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:36198/0 (socket says 172.21.15.6:36198) 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa54e2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fefa014b1f0 0x7fefa00b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:38222/0 (socket says 172.21.15.6:38222) 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa5ce3640 1 -- 172.21.15.6:0/2812501527 learned_addr learned my addr 172.21.15.6:0/2812501527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa4ce1640 1 -- 172.21.15.6:0/2812501527 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271384512 0 0) 0x7fefa00bb310 con 0x7fefa014b1f0 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa4ce1640 1 -- 172.21.15.6:0/2812501527 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef88003520 con 0x7fefa014b1f0 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa64e4640 1 -- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 msgr2=0x7fefa014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa64e4640 1 --2- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 0x7fefa014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa64e4640 1 -- 172.21.15.6:0/2812501527 >> v1:172.21.15.89:6789/0 conn(0x7fefa014b1f0 legacy=0x7fefa00b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa64e4640 1 -- 172.21.15.6:0/2812501527 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00c0120 con 0x7fefa00ba550 2023-12-19T13:33:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.690+0000 7fefa5ce3640 1 --2- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 0x7fefa014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.691+0000 7fefa64e4640 1 --2- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01554e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef90009d90 tx=0x7fef9002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=547f60369b0f1086 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.691+0000 7fefa4ce1640 1 -- 172.21.15.6:0/2812501527 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9002cc50 con 0x7fefa00ba550 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.691+0000 7fefa4ce1640 1 -- 172.21.15.6:0/2812501527 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9002cdb0 con 0x7fefa00ba550 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.691+0000 7fefa4ce1640 1 -- 172.21.15.6:0/2812501527 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90034640 con 0x7fefa00ba550 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 -- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 msgr2=0x7fefa01554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 --2- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01554e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef90009d90 tx=0x7fef9002bea0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 -- 172.21.15.6:0/2812501527 shutdown_connections 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 --2- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01554e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 --2- 172.21.15.6:0/2812501527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa006a6d0 0x7fefa014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 -- 172.21.15.6:0/2812501527 >> 172.21.15.6:0/2812501527 conn(0x7fefa00c0350 msgr2=0x7fefa00c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 -- 172.21.15.6:0/2812501527 shutdown_connections 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.692+0000 7fefa7f47640 1 -- 172.21.15.6:0/2812501527 wait complete. 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 Processor -- start 2023-12-19T13:33:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 -- start start 2023-12-19T13:33:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 0x7fefa00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa014b1f0 0x7fefa01e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00a55e0 con 0x7fefa006a6d0 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0099db0 con 0x7fefa00ba550 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.693+0000 7fefa7f47640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00b6650 con 0x7fefa014b1f0 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 0x7fefa00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 0x7fefa00a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42404/0 (socket says 172.21.15.6:42404) 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 -- 172.21.15.6:0/463946622 learned_addr learned my addr 172.21.15.6:0/463946622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa64e4640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa014b1f0 0x7fefa01e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa54e2640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 -- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa014b1f0 msgr2=0x7fefa01e3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa014b1f0 0x7fefa01e3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 -- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 msgr2=0x7fefa01e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 -- 172.21.15.6:0/463946622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980094d0 con 0x7fefa006a6d0 2023-12-19T13:33:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa5ce3640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 0x7fefa00a50a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef9800ea00 tx=0x7fef9800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800ca00 con 0x7fefa006a6d0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800cb60 con 0x7fefa006a6d0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800ced0 con 0x7fefa006a6d0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90009a70 con 0x7fefa006a6d0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.694+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa00b6c10 con 0x7fefa006a6d0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.695+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa0073a40 con 0x7fefa006a6d0 2023-12-19T13:33:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.696+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef98013470 con 0x7fefa006a6d0 2023-12-19T13:33:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.696+0000 7fef9e7fc640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef8c06a430 0x7fef8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.696+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef98088ad0 con 0x7fefa006a6d0 2023-12-19T13:33:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.696+0000 7fefa54e2640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef8c06a430 0x7fef8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.697+0000 7fefa54e2640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef8c06a430 0x7fef8c06c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefa014b040 tx=0x7fef94007cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.700+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef98054200 con 0x7fefa006a6d0 2023-12-19T13:33:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.916+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefa00a0840 con 0x7fefa006a6d0 2023-12-19T13:33:36.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.917+0000 7fef9e7fc640 1 -- 172.21.15.6:0/463946622 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7fef98017090 con 0x7fefa006a6d0 2023-12-19T13:33:36.919 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:36.919 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:36.919 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef8c06a430 msgr2=0x7fef8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef8c06a430 0x7fef8c06c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefa014b040 tx=0x7fef94007cf0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 msgr2=0x7fefa00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 0x7fefa00a50a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef9800ea00 tx=0x7fef9800eec0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 shutdown_connections 2023-12-19T13:33:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fef8c06a430 0x7fef8c06c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefa014b1f0 0x7fefa01e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00ba550 0x7fefa01e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 --2- 172.21.15.6:0/463946622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefa006a6d0 0x7fefa00a50a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 >> 172.21.15.6:0/463946622 conn(0x7fefa00c0350 msgr2=0x7fefa00a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 shutdown_connections 2023-12-19T13:33:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:36.919+0000 7fefa7f47640 1 -- 172.21.15.6:0/463946622 wait complete. 2023-12-19T13:33:36.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:37.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.035+0000 7f02df573640 1 Processor -- start 2023-12-19T13:33:37.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.035+0000 7f02df573640 1 -- start start 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02df573640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d80ba550 0x7f02d80b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02df573640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f02d80ba000 0x7f02d81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02df573640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d80bb310 con 0x7f02d806a6d0 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02df573640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80bf960 con 0x7f02d80ba550 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02df573640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80bb5b0 con 0x7f02d80ba000 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d80ba550 0x7f02d80b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d80ba550 0x7f02d80b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42406/0 (socket says 172.21.15.6:42406) 2023-12-19T13:33:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 -- 172.21.15.6:0/3145872594 learned_addr learned my addr 172.21.15.6:0/3145872594 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02ddb10640 1 --2- 172.21.15.6:0/3145872594 >> v2:172.21.15.89:3300/0 conn(0x7f02d80ba000 0x7f02d81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 -- 172.21.15.6:0/3145872594 >> v2:172.21.15.89:3300/0 conn(0x7f02d80ba000 msgr2=0x7f02d81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 --2- 172.21.15.6:0/3145872594 >> v2:172.21.15.89:3300/0 conn(0x7f02d80ba000 0x7f02d81554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 -- 172.21.15.6:0/3145872594 >> v1:172.21.15.89:6789/0 conn(0x7f02d806a6d0 legacy=0x7f02d814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.036+0000 7f02dcb0e640 1 -- 172.21.15.6:0/3145872594 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80c0120 con 0x7f02d80ba550 2023-12-19T13:33:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02dcb0e640 1 --2- 172.21.15.6:0/3145872594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d80b9ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f02d809fcb0 tx=0x7f02c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a532f9d6d697b225 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02cffff640 1 -- 172.21.15.6:0/3145872594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8030860 con 0x7f02d80ba550 2023-12-19T13:33:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02cffff640 1 -- 172.21.15.6:0/3145872594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c80309c0 con 0x7f02d80ba550 2023-12-19T13:33:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02cffff640 1 -- 172.21.15.6:0/3145872594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8030d50 con 0x7f02d80ba550 2023-12-19T13:33:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02df573640 1 -- 172.21.15.6:0/3145872594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 msgr2=0x7f02d80b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02df573640 1 --2- 172.21.15.6:0/3145872594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d80b9ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f02d809fcb0 tx=0x7f02c802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02df573640 1 -- 172.21.15.6:0/3145872594 shutdown_connections 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02df573640 1 --2- 172.21.15.6:0/3145872594 >> v2:172.21.15.89:3300/0 conn(0x7f02d80ba000 0x7f02d81554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02df573640 1 --2- 172.21.15.6:0/3145872594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d80b9ac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.037+0000 7f02df573640 1 -- 172.21.15.6:0/3145872594 >> 172.21.15.6:0/3145872594 conn(0x7f02d80c0350 msgr2=0x7f02d80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.038+0000 7f02df573640 1 -- 172.21.15.6:0/3145872594 shutdown_connections 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.038+0000 7f02df573640 1 -- 172.21.15.6:0/3145872594 wait complete. 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 Processor -- start 2023-12-19T13:33:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 -- start start 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d806a6d0 0x7f02d8146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d80ba000 0x7f02d814e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d81e34e0 con 0x7f02d80ba550 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d81e3700 con 0x7f02d80ba000 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02df573640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d81e39e0 con 0x7f02d806a6d0 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02ddb10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02ddb10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d814d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42422/0 (socket says 172.21.15.6:42422) 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02ddb10640 1 -- 172.21.15.6:0/1373992512 learned_addr learned my addr 172.21.15.6:0/1373992512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.039+0000 7f02dd30f640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d806a6d0 0x7f02d8146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02dcb0e640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d80ba000 0x7f02d814e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02ddb10640 1 -- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d806a6d0 msgr2=0x7f02d8146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02ddb10640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d806a6d0 0x7f02d8146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02ddb10640 1 -- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d80ba000 msgr2=0x7f02d814e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02ddb10640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d80ba000 0x7f02d814e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02ddb10640 1 -- 172.21.15.6:0/1373992512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80094d0 con 0x7f02d80ba550 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02dcb0e640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d80ba000 0x7f02d814e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02ddb10640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d814d380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02d000efc0 tx=0x7f02d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0014480 con 0x7f02d80ba550 2023-12-19T13:33:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d000f040 con 0x7f02d80ba550 2023-12-19T13:33:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d81e41e0 con 0x7f02d80ba550 2023-12-19T13:33:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0014820 con 0x7f02d80ba550 2023-12-19T13:33:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.040+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d814edd0 con 0x7f02d80ba550 2023-12-19T13:33:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.041+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d81e3ba0 con 0x7f02d80ba550 2023-12-19T13:33:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.042+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02d0014980 con 0x7f02d80ba550 2023-12-19T13:33:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.042+0000 7f02cdffb640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.042+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d0089710 con 0x7f02d80ba550 2023-12-19T13:33:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.042+0000 7f02dd30f640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.043+0000 7f02dd30f640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f02bc06a430 0x7f02bc06c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02d4000f60 tx=0x7f02d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.046+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02d0054d90 con 0x7f02d80ba550 2023-12-19T13:33:37.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.259+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02d81e3f00 con 0x7f02d80ba550 2023-12-19T13:33:37.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.259+0000 7f02cdffb640 1 -- 172.21.15.6:0/1373992512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3877 (secure 0 0 0) 0x7f02d81e3f00 con 0x7f02d80ba550 2023-12-19T13:33:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:37.261 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2409945819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2409945819},{"type":"v1","addr":"172.21.15.6:6834","nonce":2409945819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2802912295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802912295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2802912295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:08.029278+0000","modified":"2023-12-19T13:33:10.669689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/112295983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":112295983},{"type":"v1","addr":"172.21.15.89:6835","nonce":112295983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T13:33:37.262 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f02bc06a430 msgr2=0x7f02bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f02bc06a430 0x7f02bc06c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02d4000f60 tx=0x7f02d4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 msgr2=0x7f02d814d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d814d380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02d000efc0 tx=0x7f02d000c490 comp rx=0 tx=0).stop 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 shutdown_connections 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d80ba550 0x7f02d814d380 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d80ba000 0x7f02d814e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 --2- 172.21.15.6:0/1373992512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d806a6d0 0x7f02d8146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 >> 172.21.15.6:0/1373992512 conn(0x7f02d80c0350 msgr2=0x7f02d80a1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.261+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 shutdown_connections 2023-12-19T13:33:37.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.262+0000 7f02df573640 1 -- 172.21.15.6:0/1373992512 wait complete. 2023-12-19T13:33:37.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.378+0000 7f79751fd640 1 Processor -- start 2023-12-19T13:33:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.378+0000 7f79751fd640 1 -- start start 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f79751fd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f797006a6d0 0x7f797014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f79751fd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79700ba550 0x7f79701554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f79751fd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700bb310 con 0x7f797014b1f0 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f79751fd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700bf960 con 0x7f79700ba550 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f79751fd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700bb5b0 con 0x7f797006a6d0 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796f59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79700ba550 0x7f79701554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f797014b1f0 0x7f79700b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39410/0 (socket says 172.21.15.6:39410) 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796e59c640 1 -- 172.21.15.6:0/855838741 learned_addr learned my addr 172.21.15.6:0/855838741 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796ed9d640 1 --2- 172.21.15.6:0/855838741 >> v2:172.21.15.89:3300/0 conn(0x7f797006a6d0 0x7f797014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796f59e640 1 -- 172.21.15.6:0/855838741 >> v2:172.21.15.89:3300/0 conn(0x7f797006a6d0 msgr2=0x7f797014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796f59e640 1 --2- 172.21.15.6:0/855838741 >> v2:172.21.15.89:3300/0 conn(0x7f797006a6d0 0x7f797014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796f59e640 1 -- 172.21.15.6:0/855838741 >> v1:172.21.15.6:6789/0 conn(0x7f797014b1f0 legacy=0x7f79700b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.379+0000 7f796f59e640 1 -- 172.21.15.6:0/855838741 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700c0120 con 0x7f79700ba550 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.380+0000 7f796f59e640 1 --2- 172.21.15.6:0/855838741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79700ba550 0x7f79701554e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f797008a260 tx=0x7f796002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc5fd6a77ec845 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.380+0000 7f796dd9b640 1 -- 172.21.15.6:0/855838741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796002cc80 con 0x7f79700ba550 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.380+0000 7f796dd9b640 1 -- 172.21.15.6:0/855838741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796002cde0 con 0x7f79700ba550 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.380+0000 7f796dd9b640 1 -- 172.21.15.6:0/855838741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960034660 con 0x7f79700ba550 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.380+0000 7f79751fd640 1 -- 172.21.15.6:0/855838741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79700ba550 msgr2=0x7f79701554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 --2- 172.21.15.6:0/855838741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79700ba550 0x7f79701554e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f797008a260 tx=0x7f796002bed0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 -- 172.21.15.6:0/855838741 shutdown_connections 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 --2- 172.21.15.6:0/855838741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79700ba550 0x7f79701554e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 --2- 172.21.15.6:0/855838741 >> v2:172.21.15.89:3300/0 conn(0x7f797006a6d0 0x7f797014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 -- 172.21.15.6:0/855838741 >> 172.21.15.6:0/855838741 conn(0x7f79700c0350 msgr2=0x7f79700c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 -- 172.21.15.6:0/855838741 shutdown_connections 2023-12-19T13:33:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.381+0000 7f79751fd640 1 -- 172.21.15.6:0/855838741 wait complete. 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.382+0000 7f79751fd640 1 Processor -- start 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.382+0000 7f79751fd640 1 -- start start 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f797006a6d0 0x7f797014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79700ba550 0x7f797014cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 0x7f79700a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797014edf0 con 0x7f797014b1f0 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797014deb0 con 0x7f797006a6d0 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797014d580 con 0x7f79700ba550 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 0x7f79700a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 0x7f79700a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42442/0 (socket says 172.21.15.6:42442) 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 -- 172.21.15.6:0/132761921 learned_addr learned my addr 172.21.15.6:0/132761921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796ed9d640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f797006a6d0 0x7f797014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796e59c640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79700ba550 0x7f797014cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 -- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79700ba550 msgr2=0x7f797014cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79700ba550 0x7f797014cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 -- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f797006a6d0 msgr2=0x7f797014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f797006a6d0 0x7f797014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 -- 172.21.15.6:0/132761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009a70 con 0x7f797014b1f0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796e59c640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79700ba550 0x7f797014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f796f59e640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 0x7f79700a42f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7960009e80 tx=0x7f7960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960040650 con 0x7f797014b1f0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79600407b0 con 0x7f797014b1f0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797014d860 con 0x7f797014b1f0 2023-12-19T13:33:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960040b60 con 0x7f797014b1f0 2023-12-19T13:33:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.383+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700b4700 con 0x7f797014b1f0 2023-12-19T13:33:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.385+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797014e020 con 0x7f797014b1f0 2023-12-19T13:33:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.385+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7960040cc0 con 0x7f797014b1f0 2023-12-19T13:33:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.385+0000 7f79577fe640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f795c06a430 0x7f795c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.385+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79600ab690 con 0x7f797014b1f0 2023-12-19T13:33:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.386+0000 7f796ed9d640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f795c06a430 0x7f795c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.386+0000 7f796ed9d640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f795c06a430 0x7f795c06c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7968006fd0 tx=0x7f7968008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.390+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7960076be0 con 0x7f797014b1f0 2023-12-19T13:33:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.566+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7970073a40 con 0x7f797014b1f0 2023-12-19T13:33:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.567+0000 7f79577fe640 1 -- 172.21.15.6:0/132761921 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15941 (secure 0 0 0) 0x7f7960009450 con 0x7f797014b1f0 2023-12-19T13:33:37.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:37.569 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:09.030480+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:06.103734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:07.005290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f795c06a430 msgr2=0x7f795c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f795c06a430 0x7f795c06c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7968006fd0 tx=0x7f7968008040 comp rx=0 tx=0).stop 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 msgr2=0x7f79700a42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 0x7f79700a42f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7960009e80 tx=0x7f7960004a40 comp rx=0 tx=0).stop 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 shutdown_connections 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f795c06a430 0x7f795c06c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f797014b1f0 0x7f79700a42f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79700ba550 0x7f797014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 --2- 172.21.15.6:0/132761921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f797006a6d0 0x7f797014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 >> 172.21.15.6:0/132761921 conn(0x7f79700c0350 msgr2=0x7f7970146c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 shutdown_connections 2023-12-19T13:33:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.569+0000 7f79751fd640 1 -- 172.21.15.6:0/132761921 wait complete. 2023-12-19T13:33:37.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T13:33:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.689+0000 7f744848b640 1 Processor -- start 2023-12-19T13:33:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.689+0000 7f744848b640 1 -- start start 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.690+0000 7f744848b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 0x7f74401528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.690+0000 7f744848b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74400b7310 con 0x7f7440141390 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.690+0000 7f744848b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7440071c00 con 0x7f7440140fb0 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.690+0000 7f744848b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744014a2e0 con 0x7f744014ac30 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.690+0000 7f7445a26640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7440141390 0x7f744014a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39412/0 (socket says 172.21.15.6:39412) 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.690+0000 7f7445a26640 1 -- 172.21.15.6:0/332979878 learned_addr learned my addr 172.21.15.6:0/332979878 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446a28640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 0x7f74401528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354837512 0 0) 0x7f74400b7310 con 0x7f7440141390 2023-12-19T13:33:37.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c003520 con 0x7f7440141390 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1561945504 0 0) 0x7f742c003520 con 0x7f7440141390 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 msgr2=0x7f74401528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 0x7f74401528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 >> v1:172.21.15.89:6789/0 conn(0x7f7440140fb0 legacy=0x7f74400b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400b69e0 con 0x7f7440141390 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f7430001670 con 0x7f7440141390 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 >> v1:172.21.15.6:6789/0 conn(0x7f7440141390 legacy=0x7f744014a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0039a0 0x7f742c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 0x7f742c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c004d00 0x7f742c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744014a2e0 con 0x7f742c0039a0 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c00ba30 con 0x7f742c004d00 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c00bbf0 con 0x7f744014ac30 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446227640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0039a0 0x7f742c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7445a26640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 0x7f742c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446a28640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c004d00 0x7f742c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446227640 1 -- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 msgr2=0x7f742c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446227640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f744014ac30 0x7f742c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446227640 1 -- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c004d00 msgr2=0x7f742c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446227640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c004d00 0x7f742c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.691+0000 7f7446227640 1 -- 172.21.15.6:0/332979878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c003520 con 0x7f742c0039a0 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.692+0000 7f7446227640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0039a0 0x7f742c003d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f743c001910 tx=0x7f742c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e72b1331dd504af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.692+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c032650 con 0x7f742c0039a0 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.692+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c0327b0 con 0x7f742c0039a0 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.692+0000 7f7445225640 1 -- 172.21.15.6:0/332979878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c032b40 con 0x7f742c0039a0 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f744848b640 1 -- 172.21.15.6:0/332979878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0039a0 msgr2=0x7f742c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f744848b640 1 --2- 172.21.15.6:0/332979878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742c0039a0 0x7f742c003d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f743c001910 tx=0x7f742c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f7446a28640 1 -- 172.21.15.6:0/332979878 reap_dead start 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f744848b640 1 -- 172.21.15.6:0/332979878 shutdown_connections 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f744848b640 1 -- 172.21.15.6:0/332979878 >> 172.21.15.6:0/332979878 conn(0x7f74400bc560 msgr2=0x7f74400b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f744848b640 1 -- 172.21.15.6:0/332979878 shutdown_connections 2023-12-19T13:33:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.693+0000 7f744848b640 1 -- 172.21.15.6:0/332979878 wait complete. 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.694+0000 7f744848b640 1 Processor -- start 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.694+0000 7f744848b640 1 -- start start 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c0039a0 0x7f7440070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744013a2d0 0x7f74400b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 0x7f74400b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744012ffb0 con 0x7f74400b19d0 2023-12-19T13:33:37.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440070ea0 con 0x7f744013a2d0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744006ec90 con 0x7f742c0039a0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 0x7f74400b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 0x7f74400b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42468/0 (socket says 172.21.15.6:42468) 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 -- 172.21.15.6:0/1527753370 learned_addr learned my addr 172.21.15.6:0/1527753370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7445a26640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744013a2d0 0x7f74400b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446227640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c0039a0 0x7f7440070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 -- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c0039a0 msgr2=0x7f7440070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c0039a0 0x7f7440070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 -- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744013a2d0 msgr2=0x7f74400b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744013a2d0 0x7f74400b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 -- 172.21.15.6:0/1527753370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440130220 con 0x7f74400b19d0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7445a26640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744013a2d0 0x7f74400b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7446a28640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 0x7f74400b1e30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f744006ec40 tx=0x7f743800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800e040 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800f040 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.695+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744006f1c0 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.696+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438015430 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.696+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400701d0 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.696+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74401303b0 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.697+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7438015590 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.697+0000 7f7436ffd640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742406a430 0x7f742406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.697+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7438089090 con 0x7f74400b19d0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.697+0000 7f7446227640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742406a430 0x7f742406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.698+0000 7f7446227640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742406a430 0x7f742406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f743c036000 tx=0x7f743c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:37.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.701+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74380545e0 con 0x7f74400b19d0 2023-12-19T13:33:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.914+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7440073a40 con 0x7f74400b19d0 2023-12-19T13:33:37.916 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-12-19T13:33:37.915+0000 7f257b676640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T13:33:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.923+0000 7f7436ffd640 1 -- 172.21.15.6:0/1527753370 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7438057c00 con 0x7f74400b19d0 2023-12-19T13:33:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742406a430 msgr2=0x7f742406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742406a430 0x7f742406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f743c036000 tx=0x7f743c009030 comp rx=0 tx=0).stop 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 msgr2=0x7f74400b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 0x7f74400b1e30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f744006ec40 tx=0x7f743800f580 comp rx=0 tx=0).stop 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 shutdown_connections 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742406a430 0x7f742406c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74400b19d0 0x7f74400b1e30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744013a2d0 0x7f74400b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 --2- 172.21.15.6:0/1527753370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c0039a0 0x7f7440070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 >> 172.21.15.6:0/1527753370 conn(0x7f74400bc560 msgr2=0x7f7440148300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 shutdown_connections 2023-12-19T13:33:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:37.925+0000 7f744848b640 1 -- 172.21.15.6:0/1527753370 wait complete. 2023-12-19T13:33:37.928 INFO:tasks.ceph.mds.b.smithi089.stderr: -4676> 2023-12-19T13:33:12.629+0000 7f991da7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:33:37.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T13:33:37.958 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-19T13:33:37.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:37.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:37.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:38.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.044+0000 7fb53c85f640 1 Processor -- start 2023-12-19T13:33:38.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.044+0000 7fb53c85f640 1 -- start start 2023-12-19T13:33:38.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53c85f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5380b6990 0x7fb53806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53c85f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5380b6d70 0x7fb53814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53c85f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53806b880 con 0x7fb538071ac0 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53c85f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380b4290 con 0x7fb5380b6d70 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53c85f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380b3fb0 con 0x7fb5380b6990 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb52dd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5380b6d70 0x7fb53814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb536d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb538071ac0 0x7fb5380708a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39420/0 (socket says 172.21.15.6:39420) 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb536d9d640 1 -- 172.21.15.6:0/2889809441 learned_addr learned my addr 172.21.15.6:0/2889809441 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb52dd9b640 1 --2- 172.21.15.6:0/2889809441 >> v2:172.21.15.6:3300/0 conn(0x7fb5380b6d70 0x7fb53814e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42476/0 (socket says 172.21.15.6:42476) 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53659c640 1 --2- 172.21.15.6:0/2889809441 >> v2:172.21.15.89:3300/0 conn(0x7fb5380b6990 0x7fb53806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb52dd9b640 1 -- 172.21.15.6:0/2889809441 >> v2:172.21.15.89:3300/0 conn(0x7fb5380b6990 msgr2=0x7fb53806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb52dd9b640 1 --2- 172.21.15.6:0/2889809441 >> v2:172.21.15.89:3300/0 conn(0x7fb5380b6990 0x7fb53806a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb52dd9b640 1 -- 172.21.15.6:0/2889809441 >> v1:172.21.15.6:6789/0 conn(0x7fb538071ac0 legacy=0x7fb5380708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb52dd9b640 1 -- 172.21.15.6:0/2889809441 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538069ea0 con 0x7fb5380b6d70 2023-12-19T13:33:38.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb535d9b640 1 -- 172.21.15.6:0/2889809441 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814128077 0 0) 0x7fb53806b880 con 0x7fb538071ac0 2023-12-19T13:33:38.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.045+0000 7fb53659c640 1 --2- 172.21.15.6:0/2889809441 >> v2:172.21.15.89:3300/0 conn(0x7fb5380b6990 0x7fb53806a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.046+0000 7fb52dd9b640 1 --2- 172.21.15.6:0/2889809441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb53814e0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5200097a0 tx=0x7fb52002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec2d7e458cd193a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.046+0000 7fb535d9b640 1 -- 172.21.15.6:0/2889809441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520031830 con 0x7fb5380b6d70 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.046+0000 7fb535d9b640 1 -- 172.21.15.6:0/2889809441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb520031990 con 0x7fb5380b6d70 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.046+0000 7fb535d9b640 1 -- 172.21.15.6:0/2889809441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520031d20 con 0x7fb5380b6d70 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 -- 172.21.15.6:0/2889809441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 msgr2=0x7fb53814e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 --2- 172.21.15.6:0/2889809441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb53814e0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5200097a0 tx=0x7fb52002b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 -- 172.21.15.6:0/2889809441 shutdown_connections 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 --2- 172.21.15.6:0/2889809441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb53814e0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 --2- 172.21.15.6:0/2889809441 >> v2:172.21.15.89:3300/0 conn(0x7fb5380b6990 0x7fb53806a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 -- 172.21.15.6:0/2889809441 >> 172.21.15.6:0/2889809441 conn(0x7fb5380b9d00 msgr2=0x7fb5380ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 -- 172.21.15.6:0/2889809441 shutdown_connections 2023-12-19T13:33:38.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.047+0000 7fb53c85f640 1 -- 172.21.15.6:0/2889809441 wait complete. 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.048+0000 7fb53c85f640 1 Processor -- start 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.048+0000 7fb53c85f640 1 -- start start 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53c85f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb538071ac0 0x7fb538145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53c85f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380b6990 0x7fb5381403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53c85f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb538147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53c85f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb538145fc0 con 0x7fb5380b6d70 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53c85f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb538146ee0 con 0x7fb538071ac0 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53c85f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381e0040 con 0x7fb5380b6990 2023-12-19T13:33:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb538147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb53659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb538071ac0 0x7fb538145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb538147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42480/0 (socket says 172.21.15.6:42480) 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 -- 172.21.15.6:0/3038633593 learned_addr learned my addr 172.21.15.6:0/3038633593 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb52dd9b640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380b6990 0x7fb5381403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 -- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380b6990 msgr2=0x7fb5381403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380b6990 0x7fb5381403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 -- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb538071ac0 msgr2=0x7fb538145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb538071ac0 0x7fb538145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.049+0000 7fb536d9d640 1 -- 172.21.15.6:0/3038633593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520009400 con 0x7fb5380b6d70 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.050+0000 7fb536d9d640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb538147710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c700 tx=0x7fb53000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.050+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53000ce10 con 0x7fb5380b6d70 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.050+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53000a640 con 0x7fb5380b6d70 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.050+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5381e0320 con 0x7fb5380b6d70 2023-12-19T13:33:38.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.050+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53000aa30 con 0x7fb5380b6d70 2023-12-19T13:33:38.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.050+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381e08e0 con 0x7fb5380b6d70 2023-12-19T13:33:38.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.051+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb538066c80 con 0x7fb5380b6d70 2023-12-19T13:33:38.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.051+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb53000ab90 con 0x7fb5380b6d70 2023-12-19T13:33:38.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.052+0000 7fb52f7fe640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb51806a430 0x7fb51806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:38.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.052+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb530088070 con 0x7fb5380b6d70 2023-12-19T13:33:38.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.052+0000 7fb53659c640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb51806a430 0x7fb51806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:38.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.052+0000 7fb53659c640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb51806a430 0x7fb51806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb52800ab60 tx=0x7fb528008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:38.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.056+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb530053620 con 0x7fb5380b6d70 2023-12-19T13:33:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.269+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5381e0ad0 con 0x7fb5380b6d70 2023-12-19T13:33:38.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.930+0000 7fb52f7fe640 1 -- 172.21.15.6:0/3038633593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5300180a0 con 0x7fb5380b6d70 2023-12-19T13:33:38.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb51806a430 msgr2=0x7fb51806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb51806a430 0x7fb51806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb52800ab60 tx=0x7fb528008040 comp rx=0 tx=0).stop 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 msgr2=0x7fb538147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb538147710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c700 tx=0x7fb53000cbc0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 shutdown_connections 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb51806a430 0x7fb51806c8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5380b6d70 0x7fb538147710 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5380b6990 0x7fb5381403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 --2- 172.21.15.6:0/3038633593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb538071ac0 0x7fb538145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 >> 172.21.15.6:0/3038633593 conn(0x7fb5380b9d00 msgr2=0x7fb5380ba0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.932+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 shutdown_connections 2023-12-19T13:33:38.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:38.933+0000 7fb53c85f640 1 -- 172.21.15.6:0/3038633593 wait complete. 2023-12-19T13:33:38.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T13:33:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.106+0000 7f496a826640 1 Processor -- start 2023-12-19T13:33:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.106+0000 7f496a826640 1 -- start start 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f496a826640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49640b8690 0x7f49640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f496a826640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4964144d80 0x7f496414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f496a826640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496414ab10 con 0x7f49640b77d0 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f496a826640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496406c2f0 con 0x7f49640b8690 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f496a826640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ba620 con 0x7f4964144d80 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49640b8690 0x7f49640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49640b8690 0x7f49640b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42490/0 (socket says 172.21.15.6:42490) 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 -- 172.21.15.6:0/4146641025 learned_addr learned my addr 172.21.15.6:0/4146641025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4968dc3640 1 --2- 172.21.15.6:0/4146641025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4964144d80 0x7f496414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 -- 172.21.15.6:0/4146641025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4964144d80 msgr2=0x7f496414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 --2- 172.21.15.6:0/4146641025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4964144d80 0x7f496414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 -- 172.21.15.6:0/4146641025 >> v1:172.21.15.89:6789/0 conn(0x7f49640b77d0 legacy=0x7f4964144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.107+0000 7f4963fff640 1 -- 172.21.15.6:0/4146641025 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640b9e60 con 0x7f49640b8690 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.108+0000 7f4963fff640 1 --2- 172.21.15.6:0/4146641025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b8690 0x7f49640b8a70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4954009870 tx=0x7f495402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6463852ff227f55 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.108+0000 7f4962ffd640 1 -- 172.21.15.6:0/4146641025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540317c0 con 0x7f49640b8690 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.108+0000 7f4962ffd640 1 -- 172.21.15.6:0/4146641025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954031920 con 0x7f49640b8690 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.108+0000 7f4962ffd640 1 -- 172.21.15.6:0/4146641025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954031cb0 con 0x7f49640b8690 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 -- 172.21.15.6:0/4146641025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b8690 msgr2=0x7f49640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 --2- 172.21.15.6:0/4146641025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b8690 0x7f49640b8a70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4954009870 tx=0x7f495402b860 comp rx=0 tx=0).stop 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 -- 172.21.15.6:0/4146641025 shutdown_connections 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 --2- 172.21.15.6:0/4146641025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4964144d80 0x7f496414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 --2- 172.21.15.6:0/4146641025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b8690 0x7f49640b8a70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 -- 172.21.15.6:0/4146641025 >> 172.21.15.6:0/4146641025 conn(0x7f496406b6a0 msgr2=0x7f496406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 -- 172.21.15.6:0/4146641025 shutdown_connections 2023-12-19T13:33:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.109+0000 7f496a826640 1 -- 172.21.15.6:0/4146641025 wait complete. 2023-12-19T13:33:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.110+0000 7f496a826640 1 Processor -- start 2023-12-19T13:33:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.110+0000 7f496a826640 1 -- start start 2023-12-19T13:33:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 0x7f49641474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49640b8690 0x7f49641e0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4964144d80 0x7f4964139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964149a70 con 0x7f49640b77d0 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49641493f0 con 0x7f4964144d80 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4964148e30 con 0x7f49640b8690 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 0x7f49641474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 0x7f49641474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42492/0 (socket says 172.21.15.6:42492) 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 -- 172.21.15.6:0/3650392655 learned_addr learned my addr 172.21.15.6:0/3650392655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4968dc3640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4964144d80 0x7f4964139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f49637fe640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49640b8690 0x7f49641e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 -- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49640b8690 msgr2=0x7f49641e0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49640b8690 0x7f49641e0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 -- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4964144d80 msgr2=0x7f4964139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4964144d80 0x7f4964139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 -- 172.21.15.6:0/3650392655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49540094d0 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4968dc3640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4964144d80 0x7f4964139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f49637fe640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49640b8690 0x7f49641e0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4963fff640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 0x7f49641474b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4954000c00 tx=0x7f49540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954032860 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49540329c0 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964149690 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.111+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954032d70 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.112+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496414bc20 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.112+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4964149250 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.113+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f495404e450 con 0x7f49640b77d0 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.113+0000 7f4960ff9640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f494406a460 0x7f494406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.113+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f49540aaae0 con 0x7f49640b77d0 2023-12-19T13:33:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.113+0000 7f49637fe640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f494406a460 0x7f494406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.114+0000 7f49637fe640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f494406a460 0x7f494406c920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f496413a5d0 tx=0x7f494c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.118+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4964149250 con 0x7f49640b77d0 2023-12-19T13:33:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.294+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4964149bb0 con 0x7f49640b77d0 2023-12-19T13:33:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.932+0000 7f4960ff9640 1 -- 172.21.15.6:0/3650392655 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4964149bb0 con 0x7f49640b77d0 2023-12-19T13:33:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f494406a460 msgr2=0x7f494406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f494406a460 0x7f494406c920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f496413a5d0 tx=0x7f494c008040 comp rx=0 tx=0).stop 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 msgr2=0x7f49641474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 0x7f49641474b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4954000c00 tx=0x7f49540046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 shutdown_connections 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f494406a460 0x7f494406c920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4964144d80 0x7f4964139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49640b8690 0x7f49641e0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 --2- 172.21.15.6:0/3650392655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49640b77d0 0x7f49641474b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 >> 172.21.15.6:0/3650392655 conn(0x7f496406b6a0 msgr2=0x7f49640ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 shutdown_connections 2023-12-19T13:33:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:39.935+0000 7f496a826640 1 -- 172.21.15.6:0/3650392655 wait complete. 2023-12-19T13:33:39.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T13:33:40.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.065+0000 7f0db69f0640 1 Processor -- start 2023-12-19T13:33:40.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.065+0000 7f0db69f0640 1 -- start start 2023-12-19T13:33:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0db69f0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db00b8690 0x7f0db00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0db69f0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db014ab10 con 0x7f0db0144d80 2023-12-19T13:33:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0db69f0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db006c2f0 con 0x7f0db00b77d0 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0db69f0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00ba620 con 0x7f0db00b8690 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0daffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db00b8690 0x7f0db00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0db4f8d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0db0144d80 0x7f0db014afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39430/0 (socket says 172.21.15.6:39430) 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0db4f8d640 1 -- 172.21.15.6:0/1816181467 learned_addr learned my addr 172.21.15.6:0/1816181467 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0daffff640 1 -- 172.21.15.6:0/1816181467 >> v1:172.21.15.89:6789/0 conn(0x7f0db00b77d0 legacy=0x7f0db0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0daffff640 1 -- 172.21.15.6:0/1816181467 >> v1:172.21.15.6:6789/0 conn(0x7f0db0144d80 legacy=0x7f0db014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.066+0000 7f0daffff640 1 -- 172.21.15.6:0/1816181467 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00b9e60 con 0x7f0db00b8690 2023-12-19T13:33:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.067+0000 7f0daffff640 1 --2- 172.21.15.6:0/1816181467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db00b8a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0da00097a0 tx=0x7f0da002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d9584edd090c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.067+0000 7f0daeffd640 1 -- 172.21.15.6:0/1816181467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da002e070 con 0x7f0db00b8690 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.067+0000 7f0daeffd640 1 -- 172.21.15.6:0/1816181467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da00315a0 con 0x7f0db00b8690 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.067+0000 7f0daeffd640 1 -- 172.21.15.6:0/1816181467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0031930 con 0x7f0db00b8690 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 -- 172.21.15.6:0/1816181467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 msgr2=0x7f0db00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 --2- 172.21.15.6:0/1816181467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db00b8a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0da00097a0 tx=0x7f0da002b840 comp rx=0 tx=0).stop 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 -- 172.21.15.6:0/1816181467 shutdown_connections 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 --2- 172.21.15.6:0/1816181467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db00b8a70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 -- 172.21.15.6:0/1816181467 >> 172.21.15.6:0/1816181467 conn(0x7f0db006b6a0 msgr2=0x7f0db006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 -- 172.21.15.6:0/1816181467 shutdown_connections 2023-12-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.068+0000 7f0db69f0640 1 -- 172.21.15.6:0/1816181467 wait complete. 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.069+0000 7f0db69f0640 1 Processor -- start 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.069+0000 7f0db69f0640 1 -- start start 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db00b77d0 0x7f0db01d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db01d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db0144d80 0x7f0db01e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01d7580 con 0x7f0db00b8690 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0149f30 con 0x7f0db00b77d0 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01d7840 con 0x7f0db0144d80 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db01d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db01d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42514/0 (socket says 172.21.15.6:42514) 2023-12-19T13:33:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 -- 172.21.15.6:0/2583644613 learned_addr learned my addr 172.21.15.6:0/2583644613 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daffff640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db00b77d0 0x7f0db01d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db4f8d640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db0144d80 0x7f0db01e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 -- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db0144d80 msgr2=0x7f0db01e33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db0144d80 0x7f0db01e33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 -- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db00b77d0 msgr2=0x7f0db01d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db00b77d0 0x7f0db01d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 -- 172.21.15.6:0/2583644613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0009400 con 0x7f0db00b8690 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daffff640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db00b77d0 0x7f0db01d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0daf7fe640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db01d0c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c430 tx=0x7f0da400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4011790 con 0x7f0db00b8690 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40118f0 con 0x7f0db00b8690 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db0147f90 con 0x7f0db00b8690 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.070+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4011ce0 con 0x7f0db00b8690 2023-12-19T13:33:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.071+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db014a790 con 0x7f0db00b8690 2023-12-19T13:33:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.071+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db01d1150 con 0x7f0db00b8690 2023-12-19T13:33:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.072+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0da401c460 con 0x7f0db00b8690 2023-12-19T13:33:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.072+0000 7f0dacff9640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d9c06a430 0x7f0d9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.072+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0da40886f0 con 0x7f0db00b8690 2023-12-19T13:33:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.072+0000 7f0daffff640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d9c06a430 0x7f0d9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.073+0000 7f0daffff640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d9c06a430 0x7f0d9c06c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0da0036000 tx=0x7f0da003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.076+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0da4053ed0 con 0x7f0db00b8690 2023-12-19T13:33:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.258+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0db01d7a60 con 0x7f0db00b8690 2023-12-19T13:33:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.939+0000 7f0dacff9640 1 -- 172.21.15.6:0/2583644613 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0da40574f0 con 0x7f0db00b8690 2023-12-19T13:33:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d9c06a430 msgr2=0x7f0d9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d9c06a430 0x7f0d9c06c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0da0036000 tx=0x7f0da003d040 comp rx=0 tx=0).stop 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 msgr2=0x7f0db01d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db01d0c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c430 tx=0x7f0da400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 shutdown_connections 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d9c06a430 0x7f0d9c06c8f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db0144d80 0x7f0db01e33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db00b8690 0x7f0db01d0c10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 --2- 172.21.15.6:0/2583644613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db00b77d0 0x7f0db01d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 >> 172.21.15.6:0/2583644613 conn(0x7f0db006b6a0 msgr2=0x7f0db00ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 shutdown_connections 2023-12-19T13:33:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:40.943+0000 7f0db69f0640 1 -- 172.21.15.6:0/2583644613 wait complete. 2023-12-19T13:33:40.959 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T13:33:40.960 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T13:33:40.960 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T13:33:40.960 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:33:40.960 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T13:33:40.960 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T13:33:40.960 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T13:33:40.960 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:33:40.961 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T13:33:40.961 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T13:33:40.961 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T13:33:40.961 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T13:33:40.971 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T13:33:40.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T13:33:40.972 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T13:33:40.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T13:33:40.973 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T13:33:40.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T13:33:41.015 INFO:tasks.ceph.mds.a:Started 2023-12-19T13:33:41.015 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:41.016 INFO:tasks.ceph.mds.c:Started 2023-12-19T13:33:41.016 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:41.017 INFO:tasks.ceph.mds.b:Started 2023-12-19T13:33:41.017 DEBUG:teuthology.parallel:result is None 2023-12-19T13:33:41.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T13:33:41.096 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-19T13:33:41.102 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-12-19T13:33:41.103 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-12-19T13:33:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.136+0000 7f49df9c9640 1 Processor -- start 2023-12-19T13:33:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.136+0000 7f49df9c9640 1 -- start start 2023-12-19T13:33:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49df9c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d8141600 0x7f49d80bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49df9c9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d80bacc0 con 0x7f49d814aa00 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49dcf64640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f49d814aa00 0x7f49d8140ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39450/0 (socket says 172.21.15.6:39450) 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49dcf64640 1 -- 172.21.15.6:0/3179769004 learned_addr learned my addr 172.21.15.6:0/3179769004 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d80bbe60 con 0x7f49d80b79f0 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80bbca0 con 0x7f49d8141600 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49ddf66640 1 --2- 172.21.15.6:0/3179769004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d8141600 0x7f49d80bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49cffff640 1 -- 172.21.15.6:0/3179769004 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140890180 0 0) 0x7f49d80bacc0 con 0x7f49d814aa00 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49cffff640 1 -- 172.21.15.6:0/3179769004 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c4003520 con 0x7f49d814aa00 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49cffff640 1 -- 172.21.15.6:0/3179769004 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005482334 0 0) 0x7f49d80bbe60 con 0x7f49d80b79f0 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49ddf66640 1 -- 172.21.15.6:0/3179769004 >> v1:172.21.15.89:6789/0 conn(0x7f49d80b79f0 legacy=0x7f49d80b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49ddf66640 1 -- 172.21.15.6:0/3179769004 >> v1:172.21.15.6:6789/0 conn(0x7f49d814aa00 legacy=0x7f49d8140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.137+0000 7f49ddf66640 1 -- 172.21.15.6:0/3179769004 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80b8bc0 con 0x7f49d8141600 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.138+0000 7f49ddf66640 1 --2- 172.21.15.6:0/3179769004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d8141600 0x7f49d80bb760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009dc0 tx=0x7f49d002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d78f647caff5ee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.138+0000 7f49cffff640 1 -- 172.21.15.6:0/3179769004 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d002cd50 con 0x7f49d8141600 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.138+0000 7f49cffff640 1 -- 172.21.15.6:0/3179769004 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0034440 con 0x7f49d8141600 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.138+0000 7f49cffff640 1 -- 172.21.15.6:0/3179769004 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d00347b0 con 0x7f49d8141600 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d8141600 msgr2=0x7f49d80bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3179769004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d8141600 0x7f49d80bb760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009dc0 tx=0x7f49d002bfa0 comp rx=0 tx=0).stop 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 shutdown_connections 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3179769004 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d8141600 0x7f49d80bb760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 >> 172.21.15.6:0/3179769004 conn(0x7f49d80c0340 msgr2=0x7f49d80c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 shutdown_connections 2023-12-19T13:33:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.139+0000 7f49df9c9640 1 -- 172.21.15.6:0/3179769004 wait complete. 2023-12-19T13:33:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.140+0000 7f49df9c9640 1 Processor -- start 2023-12-19T13:33:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.140+0000 7f49df9c9640 1 -- start start 2023-12-19T13:33:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d80b79f0 0x7f49d80bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d8141600 0x7f49d8147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d814aa00 0x7f49d814d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8146150 con 0x7f49d814aa00 2023-12-19T13:33:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8145d30 con 0x7f49d8141600 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80bf920 con 0x7f49d80b79f0 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dcf64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d8141600 0x7f49d8147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d80b79f0 0x7f49d80bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dcf64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d8141600 0x7f49d8147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:42316/0 (socket says 172.21.15.6:42316) 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dcf64640 1 -- 172.21.15.6:0/3138636168 learned_addr learned my addr 172.21.15.6:0/3138636168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49ddf66640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d814aa00 0x7f49d814d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 -- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d8141600 msgr2=0x7f49d8147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d8141600 0x7f49d8147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 -- 172.21.15.6:0/3138636168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d814aa00 msgr2=0x7f49d814d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d814aa00 0x7f49d814d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 -- 172.21.15.6:0/3138636168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009a70 con 0x7f49d80b79f0 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49dd765640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d80b79f0 0x7f49d80bf3e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c400 tx=0x7f49d400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40035f0 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4003770 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4003b20 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.141+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d8145390 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.142+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d8145950 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.143+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d8073a40 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.143+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f49d4003c80 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.143+0000 7f49cdffb640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f49bc06a460 0x7f49bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.143+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f49d4087a90 con 0x7f49d80b79f0 2023-12-19T13:33:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.143+0000 7f49dcf64640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f49bc06a460 0x7f49bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.144+0000 7f49dcf64640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f49bc06a460 0x7f49bc06c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f49d81da1a0 tx=0x7f49c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.148+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f49d40534c0 con 0x7f49d80b79f0 2023-12-19T13:33:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:41.343+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f49d813f2e0 con 0x7f49d80b79f0 2023-12-19T13:33:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.127+0000 7f49cdffb640 1 -- 172.21.15.6:0/3138636168 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f49d4017080 con 0x7f49d80b79f0 2023-12-19T13:33:42.130 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-12-19T13:33:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f49bc06a460 msgr2=0x7f49bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f49bc06a460 0x7f49bc06c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f49d81da1a0 tx=0x7f49c8009040 comp rx=0 tx=0).stop 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d80b79f0 msgr2=0x7f49d80bf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d80b79f0 0x7f49d80bf3e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c400 tx=0x7f49d400c8c0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 shutdown_connections 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f49bc06a460 0x7f49bc06c920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d814aa00 0x7f49d814d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d8141600 0x7f49d8147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 --2- 172.21.15.6:0/3138636168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d80b79f0 0x7f49d80bf3e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 >> 172.21.15.6:0/3138636168 conn(0x7f49d80c0340 msgr2=0x7f49d813fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 shutdown_connections 2023-12-19T13:33:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.130+0000 7f49df9c9640 1 -- 172.21.15.6:0/3138636168 wait complete. 2023-12-19T13:33:42.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T13:33:42.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.256+0000 7feac2573640 1 Processor -- start 2023-12-19T13:33:42.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.256+0000 7feac2573640 1 -- start start 2023-12-19T13:33:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.256+0000 7feac2573640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.256+0000 7feac2573640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feabc071ab0 0x7feabc069d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.256+0000 7feac2573640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feabc0708b0 0x7feabc14e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.256+0000 7feac2573640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0b4110 con 0x7feabc0708b0 2023-12-19T13:33:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac2573640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc14ad20 con 0x7feabc071ab0 2023-12-19T13:33:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac2573640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc14b000 con 0x7feabc144ea0 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feabc0708b0 0x7feabc14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feabc0708b0 0x7feabc14e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42578/0 (socket says 172.21.15.6:42578) 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 -- 172.21.15.6:0/2044890055 learned_addr learned my addr 172.21.15.6:0/2044890055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feabbfff640 1 --2- 172.21.15.6:0/2044890055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feabb7fe640 1 --2- 172.21.15.6:0/2044890055 >> v2:172.21.15.89:3300/0 conn(0x7feabc071ab0 0x7feabc069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 -- 172.21.15.6:0/2044890055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 msgr2=0x7feabc0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 --2- 172.21.15.6:0/2044890055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 -- 172.21.15.6:0/2044890055 >> v2:172.21.15.89:3300/0 conn(0x7feabc071ab0 msgr2=0x7feabc069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 --2- 172.21.15.6:0/2044890055 >> v2:172.21.15.89:3300/0 conn(0x7feabc071ab0 0x7feabc069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.257+0000 7feac0b10640 1 -- 172.21.15.6:0/2044890055 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc14b2e0 con 0x7feabc0708b0 2023-12-19T13:33:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac0b10640 1 --2- 172.21.15.6:0/2044890055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc0708b0 0x7feabc14e180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feabc0b94b0 tx=0x7feab402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51a5646f3c6a031 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feabaffd640 1 -- 172.21.15.6:0/2044890055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab402cb00 con 0x7feabc0708b0 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feabaffd640 1 -- 172.21.15.6:0/2044890055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab402cc60 con 0x7feabc0708b0 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feabaffd640 1 -- 172.21.15.6:0/2044890055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40343f0 con 0x7feabc0708b0 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac2573640 1 -- 172.21.15.6:0/2044890055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc0708b0 msgr2=0x7feabc14e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac2573640 1 --2- 172.21.15.6:0/2044890055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc0708b0 0x7feabc14e180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feabc0b94b0 tx=0x7feab402bf60 comp rx=0 tx=0).stop 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac2573640 1 -- 172.21.15.6:0/2044890055 shutdown_connections 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac2573640 1 --2- 172.21.15.6:0/2044890055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc0708b0 0x7feabc14e180 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac2573640 1 --2- 172.21.15.6:0/2044890055 >> v2:172.21.15.89:3300/0 conn(0x7feabc071ab0 0x7feabc069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.258+0000 7feac2573640 1 --2- 172.21.15.6:0/2044890055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.259+0000 7feac2573640 1 -- 172.21.15.6:0/2044890055 >> 172.21.15.6:0/2044890055 conn(0x7feabc0bd240 msgr2=0x7feabc0bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.259+0000 7feac2573640 1 -- 172.21.15.6:0/2044890055 shutdown_connections 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.259+0000 7feac2573640 1 -- 172.21.15.6:0/2044890055 wait complete. 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 Processor -- start 2023-12-19T13:33:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 -- start start 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feabc0708b0 0x7feabc1d2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 0x7feabc1d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc1d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1d0f50 con 0x7feabc071ab0 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1e0210 con 0x7feabc0708b0 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feac2573640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1e04f0 con 0x7feabc144ea0 2023-12-19T13:33:42.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feabb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 0x7feabc1d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.260+0000 7feabb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 0x7feabc1d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42590/0 (socket says 172.21.15.6:42590) 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 -- 172.21.15.6:0/3054710059 learned_addr learned my addr 172.21.15.6:0/3054710059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabbfff640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feabc0708b0 0x7feabc1d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feac0b10640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc1d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 -- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 msgr2=0x7feabc1d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc1d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 -- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feabc0708b0 msgr2=0x7feabc1d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feabc0708b0 0x7feabc1d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 -- 172.21.15.6:0/3054710059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009b30 con 0x7feabc071ab0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabbfff640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feabc0708b0 0x7feabc1d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feabb7fe640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 0x7feabc1d2ec0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feaac00e890 tx=0x7feaac00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00c940 con 0x7feabc071ab0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00caa0 con 0x7feabc071ab0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc0bd620 con 0x7feabc071ab0 2023-12-19T13:33:42.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00ce30 con 0x7feabc071ab0 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.261+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc1dfe70 con 0x7feabc071ab0 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.262+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc073a40 con 0x7feabc071ab0 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.263+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feaac013470 con 0x7feabc071ab0 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.263+0000 7feab8ff9640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feaa806a460 0x7feaa806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.263+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feaac0886e0 con 0x7feabc071ab0 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.263+0000 7feabbfff640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feaa806a460 0x7feaa806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.264+0000 7feabbfff640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feaa806a460 0x7feaa806c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feab0009af0 tx=0x7feab0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.268+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feaac0540c0 con 0x7feabc071ab0 2023-12-19T13:33:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.509+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feabc1d1090 con 0x7feabc071ab0 2023-12-19T13:33:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.510+0000 7feab8ff9640 1 -- 172.21.15.6:0/3054710059 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7feabc1d1090 con 0x7feabc071ab0 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBam4FlUyiCJxAAHxiXo1cJj88C99BHaptcjA==", 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBam4FlFwG2NBAAuX9czzxSB8oBNxY+UsyL3A==", 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBam4Flwy+CLxAAKW1EEmQKEEl9FmV298Tf0g==", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBem4FlCq4lFhAA/D6TRlsnXU/8a3EuZ6V+zg==", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBhm4FlSSTxFRAAK7DaJ847voiGgCKTM2uIuA==", 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBkm4FlQltdFRAAyTVGePcQ5hFbEKGLiysVwA==", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBnm4FlwVogFBAAdjFTdBHmhp013VUppwd0zA==", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBtm4FlXmejFxAA439Qwc2e2bQ1HUyUb8WWwQ==", 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBwm4FlmzuxFRAA9jlmMXWne9YbBG6F0LBzMw==", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBzm4Fl//CdExAAcEwl0BmEIfFinQaBsqU0sA==", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB2m4FlintYEhAAP6SPI15p9gZJH9q/3oMnHQ==", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBbm4FlAdIsAxAAufEa2ozXomX8m2NUoIgckg==", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-12-19T13:33:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg==", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB7m4Fl3CUIMxAAXc/3KQgay4SWXbBrhU1NVw==", 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB7m4FlGi8IMxAAOT2MebNt5HiEoNPCyp7/Vg==", 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB7m4Fl2DYIMxAAKAOVyTumPnVGgz/3uYrltQ==", 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB7m4FlCEAIMxAAjDC5y//34GC/ij/zQakyxQ==", 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB7m4FlkEcIMxAARyXPYk/F1OTGKWsgYlMMkA==", 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB7m4FlDU8IMxAALecJSk7MvuspPl0gOn/yCg==", 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-12-19T13:33:42.523 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBam4FlwMqrIxAABWSyozd2+1/fHBhKuykVNQ==", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBam4Fl7Y6BHxAAEAne9NwNJlJ9q3gvvu6NFA==", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-12-19T13:33:42.525 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T13:33:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feaa806a460 msgr2=0x7feaa806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feaa806a460 0x7feaa806c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feab0009af0 tx=0x7feab0008040 comp rx=0 tx=0).stop 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 msgr2=0x7feabc1d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 0x7feabc1d2ec0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feaac00e890 tx=0x7feaac00ed50 comp rx=0 tx=0).stop 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 shutdown_connections 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7feaa806a460 0x7feaa806c920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feabc144ea0 0x7feabc1d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feabc071ab0 0x7feabc1d2ec0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 --2- 172.21.15.6:0/3054710059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feabc0708b0 0x7feabc1d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.511+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 >> 172.21.15.6:0/3054710059 conn(0x7feabc0bd240 msgr2=0x7feabc069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.512+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 shutdown_connections 2023-12-19T13:33:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.512+0000 7feac2573640 1 -- 172.21.15.6:0/3054710059 wait complete. 2023-12-19T13:33:42.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T13:33:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.632+0000 7fae54dd9640 1 Processor -- start 2023-12-19T13:33:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.632+0000 7fae54dd9640 1 -- start start 2023-12-19T13:33:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae54dd9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae5006b9d0 0x7fae5006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae54dd9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fae50153480 0x7fae50155870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae54dd9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5006eae0 con 0x7fae5006bdb0 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae54dd9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5006cee0 con 0x7fae5006b9d0 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae54dd9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5014e100 con 0x7fae50153480 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae5006b9d0 0x7fae5006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae5006b9d0 0x7fae5006c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42600/0 (socket says 172.21.15.6:42600) 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.633+0000 7fae4e59c640 1 -- 172.21.15.6:0/1445702790 learned_addr learned my addr 172.21.15.6:0/1445702790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4ed9d640 1 --2- 172.21.15.6:0/1445702790 >> v2:172.21.15.89:3300/0 conn(0x7fae50153480 0x7fae50155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4e59c640 1 -- 172.21.15.6:0/1445702790 >> v2:172.21.15.89:3300/0 conn(0x7fae50153480 msgr2=0x7fae50155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4e59c640 1 --2- 172.21.15.6:0/1445702790 >> v2:172.21.15.89:3300/0 conn(0x7fae50153480 0x7fae50155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4e59c640 1 -- 172.21.15.6:0/1445702790 >> v1:172.21.15.89:6789/0 conn(0x7fae5006bdb0 legacy=0x7fae5006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4e59c640 1 -- 172.21.15.6:0/1445702790 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5006e6c0 con 0x7fae5006b9d0 2023-12-19T13:33:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4ed9d640 1 --2- 172.21.15.6:0/1445702790 >> v2:172.21.15.89:3300/0 conn(0x7fae50153480 0x7fae50155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4e59c640 1 --2- 172.21.15.6:0/1445702790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006b9d0 0x7fae5006c9a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae50070f00 tx=0x7fae4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2910894b5509be19 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.634+0000 7fae4d59a640 1 -- 172.21.15.6:0/1445702790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44031870 con 0x7fae5006b9d0 2023-12-19T13:33:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae4d59a640 1 -- 172.21.15.6:0/1445702790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae440319d0 con 0x7fae5006b9d0 2023-12-19T13:33:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae4d59a640 1 -- 172.21.15.6:0/1445702790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44031d60 con 0x7fae5006b9d0 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 -- 172.21.15.6:0/1445702790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006b9d0 msgr2=0x7fae5006c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1445702790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006b9d0 0x7fae5006c9a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae50070f00 tx=0x7fae4402b910 comp rx=0 tx=0).stop 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 -- 172.21.15.6:0/1445702790 shutdown_connections 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1445702790 >> v2:172.21.15.89:3300/0 conn(0x7fae50153480 0x7fae50155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1445702790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006b9d0 0x7fae5006c9a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 -- 172.21.15.6:0/1445702790 >> 172.21.15.6:0/1445702790 conn(0x7fae500be1e0 msgr2=0x7fae500be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 -- 172.21.15.6:0/1445702790 shutdown_connections 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.635+0000 7fae54dd9640 1 -- 172.21.15.6:0/1445702790 wait complete. 2023-12-19T13:33:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.636+0000 7fae54dd9640 1 Processor -- start 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.636+0000 7fae54dd9640 1 -- start start 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae54dd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae5006b9d0 0x7fae500a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae54dd9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 0x7fae50149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae54dd9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae50153480 0x7fae500a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae54dd9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500a1d20 con 0x7fae5006bdb0 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae54dd9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50149c70 con 0x7fae50153480 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae54dd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014a700 con 0x7fae5006b9d0 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 0x7fae50149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 0x7fae50149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42616/0 (socket says 172.21.15.6:42616) 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 -- 172.21.15.6:0/1365285419 learned_addr learned my addr 172.21.15.6:0/1365285419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4e59c640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae5006b9d0 0x7fae500a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4ed9d640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae50153480 0x7fae500a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 -- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae5006b9d0 msgr2=0x7fae500a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae5006b9d0 0x7fae500a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 -- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae50153480 msgr2=0x7fae500a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae50153480 0x7fae500a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4dd9b640 1 -- 172.21.15.6:0/1365285419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae440094d0 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.637+0000 7fae4ed9d640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae50153480 0x7fae500a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.638+0000 7fae4dd9b640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 0x7fae50149730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c410 tx=0x7fae4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.638+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae400035f0 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.638+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae40003750 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.638+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40003b40 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.638+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae500a2c00 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.638+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae500a3160 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.639+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae50066e90 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.639+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae40003ca0 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.640+0000 7fae3effd640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fae3006a430 0x7fae3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.640+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae400876f0 con 0x7fae5006bdb0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.640+0000 7fae4e59c640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fae3006a430 0x7fae3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.640+0000 7fae4e59c640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fae3006a430 0x7fae3006c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae44036000 tx=0x7fae4403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.644+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae40053170 con 0x7fae5006bdb0 2023-12-19T13:33:42.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.886+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fae50073a40 con 0x7fae5006bdb0 2023-12-19T13:33:42.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.889+0000 7fae3effd640 1 -- 172.21.15.6:0/1365285419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fae40056790 con 0x7fae5006bdb0 2023-12-19T13:33:42.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fae3006a430 msgr2=0x7fae3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fae3006a430 0x7fae3006c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae44036000 tx=0x7fae4403c040 comp rx=0 tx=0).stop 2023-12-19T13:33:42.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 msgr2=0x7fae50149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:42.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 0x7fae50149730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c410 tx=0x7fae4000c8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 shutdown_connections 2023-12-19T13:33:42.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fae3006a430 0x7fae3006c8f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae50153480 0x7fae500a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae5006bdb0 0x7fae50149730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 --2- 172.21.15.6:0/1365285419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae5006b9d0 0x7fae500a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 >> 172.21.15.6:0/1365285419 conn(0x7fae500be1e0 msgr2=0x7fae500b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 shutdown_connections 2023-12-19T13:33:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:42.891+0000 7fae54dd9640 1 -- 172.21.15.6:0/1365285419 wait complete. 2023-12-19T13:33:42.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T13:33:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.008+0000 7fe618799640 1 Processor -- start 2023-12-19T13:33:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.008+0000 7fe618799640 1 -- start start 2023-12-19T13:33:43.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe618799640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6100b7fb0 0x7fe6100b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe618799640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6100b8cf0 0x7fe6101554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe618799640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61014ef70 con 0x7fe610144dd0 2023-12-19T13:33:43.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe618799640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100b9a20 con 0x7fe6100b8cf0 2023-12-19T13:33:43.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe618799640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100b6d30 con 0x7fe6100b7fb0 2023-12-19T13:33:43.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616535640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe610144dd0 0x7fe61014e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39456/0 (socket says 172.21.15.6:39456) 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616d36640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6100b8cf0 0x7fe6101554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616535640 1 -- 172.21.15.6:0/3482272035 learned_addr learned my addr 172.21.15.6:0/3482272035 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe615d34640 1 --2- 172.21.15.6:0/3482272035 >> v2:172.21.15.89:3300/0 conn(0x7fe6100b7fb0 0x7fe6100b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616d36640 1 -- 172.21.15.6:0/3482272035 >> v2:172.21.15.89:3300/0 conn(0x7fe6100b7fb0 msgr2=0x7fe6100b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616d36640 1 --2- 172.21.15.6:0/3482272035 >> v2:172.21.15.89:3300/0 conn(0x7fe6100b7fb0 0x7fe6100b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616d36640 1 -- 172.21.15.6:0/3482272035 >> v1:172.21.15.6:6789/0 conn(0x7fe610144dd0 legacy=0x7fe61014e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe616d36640 1 -- 172.21.15.6:0/3482272035 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100b9120 con 0x7fe6100b8cf0 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe615533640 1 -- 172.21.15.6:0/3482272035 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269180913 0 0) 0x7fe61014ef70 con 0x7fe610144dd0 2023-12-19T13:33:43.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.009+0000 7fe615d34640 1 --2- 172.21.15.6:0/3482272035 >> v2:172.21.15.89:3300/0 conn(0x7fe6100b7fb0 0x7fe6100b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.010+0000 7fe616d36640 1 --2- 172.21.15.6:0/3482272035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6100b8cf0 0x7fe6101554c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe6100c1130 tx=0x7fe60802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6d186c550b01e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.010+0000 7fe615533640 1 -- 172.21.15.6:0/3482272035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608030610 con 0x7fe6100b8cf0 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.010+0000 7fe615533640 1 -- 172.21.15.6:0/3482272035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608030770 con 0x7fe6100b8cf0 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.010+0000 7fe615533640 1 -- 172.21.15.6:0/3482272035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608030b00 con 0x7fe6100b8cf0 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 -- 172.21.15.6:0/3482272035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6100b8cf0 msgr2=0x7fe6101554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 --2- 172.21.15.6:0/3482272035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6100b8cf0 0x7fe6101554c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe6100c1130 tx=0x7fe60802b960 comp rx=0 tx=0).stop 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 -- 172.21.15.6:0/3482272035 shutdown_connections 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 --2- 172.21.15.6:0/3482272035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6100b8cf0 0x7fe6101554c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 --2- 172.21.15.6:0/3482272035 >> v2:172.21.15.89:3300/0 conn(0x7fe6100b7fb0 0x7fe6100b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 -- 172.21.15.6:0/3482272035 >> 172.21.15.6:0/3482272035 conn(0x7fe6100c03d0 msgr2=0x7fe6100c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 -- 172.21.15.6:0/3482272035 shutdown_connections 2023-12-19T13:33:43.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.011+0000 7fe618799640 1 -- 172.21.15.6:0/3482272035 wait complete. 2023-12-19T13:33:43.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.012+0000 7fe618799640 1 Processor -- start 2023-12-19T13:33:43.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.012+0000 7fe618799640 1 -- start start 2023-12-19T13:33:43.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.012+0000 7fe618799640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6100b7fb0 0x7fe61014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.012+0000 7fe618799640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6100b8cf0 0x7fe6101dfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.012+0000 7fe618799640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 0x7fe6100aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe618799640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe610149df0 con 0x7fe610144dd0 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe618799640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61014dd50 con 0x7fe6100b8cf0 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe618799640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6101497c0 con 0x7fe6100b7fb0 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 0x7fe6100aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 0x7fe6100aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42628/0 (socket says 172.21.15.6:42628) 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 -- 172.21.15.6:0/903823901 learned_addr learned my addr 172.21.15.6:0/903823901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe615d34640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6100b8cf0 0x7fe6101dfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616535640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6100b7fb0 0x7fe61014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 -- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6100b7fb0 msgr2=0x7fe61014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6100b7fb0 0x7fe61014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 -- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6100b8cf0 msgr2=0x7fe6101dfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6100b8cf0 0x7fe6101dfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 -- 172.21.15.6:0/903823901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608009400 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616535640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6100b7fb0 0x7fe61014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe616d36640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 0x7fe6100aca20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe60802bf70 tx=0x7fe608004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60803e040 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608039c30 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61014b550 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080443f0 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.013+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe610149a10 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.014+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe610149f30 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.015+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe608044550 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.015+0000 7fe606ffd640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.015+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6080aa9f0 con 0x7fe610144dd0 2023-12-19T13:33:43.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.015+0000 7fe616535640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.016+0000 7fe616535640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe60c007fd0 tx=0x7fe60c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.020+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe610149f30 con 0x7fe610144dd0 2023-12-19T13:33:43.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.269+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe610149f30 con 0x7fe610144dd0 2023-12-19T13:33:43.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.272+0000 7fe606ffd640 1 -- 172.21.15.6:0/903823901 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe610149f30 con 0x7fe610144dd0 2023-12-19T13:33:43.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 msgr2=0x7fe5f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe60c007fd0 tx=0x7fe60c009040 comp rx=0 tx=0).stop 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 msgr2=0x7fe6100aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 0x7fe6100aca20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe60802bf70 tx=0x7fe608004730 comp rx=0 tx=0).stop 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 shutdown_connections 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5f406a430 0x7fe5f406c8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe610144dd0 0x7fe6100aca20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6100b8cf0 0x7fe6101dfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 --2- 172.21.15.6:0/903823901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6100b7fb0 0x7fe61014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 >> 172.21.15.6:0/903823901 conn(0x7fe6100c03d0 msgr2=0x7fe6100bf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 shutdown_connections 2023-12-19T13:33:43.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.274+0000 7fe618799640 1 -- 172.21.15.6:0/903823901 wait complete. 2023-12-19T13:33:43.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T13:33:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 Processor -- start 2023-12-19T13:33:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 -- start start 2023-12-19T13:33:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38400b7a40 0x7f38400b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38401410f0 0x7f3840141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38400b8ac0 con 0x7f38400bad10 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400b8da0 con 0x7f38400b7a40 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f38465d2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400b9ea0 con 0x7f38401410f0 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f383ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38400b7a40 0x7f38400b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f383ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38400b7a40 0x7f38400b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42636/0 (socket says 172.21.15.6:42636) 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.392+0000 7f383ffff640 1 -- 172.21.15.6:0/1112306500 learned_addr learned my addr 172.21.15.6:0/1112306500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f3844b6f640 1 --2- 172.21.15.6:0/1112306500 >> v2:172.21.15.89:3300/0 conn(0x7f38401410f0 0x7f3840141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f383ffff640 1 -- 172.21.15.6:0/1112306500 >> v2:172.21.15.89:3300/0 conn(0x7f38401410f0 msgr2=0x7f3840141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f383ffff640 1 --2- 172.21.15.6:0/1112306500 >> v2:172.21.15.89:3300/0 conn(0x7f38401410f0 0x7f3840141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f383ffff640 1 -- 172.21.15.6:0/1112306500 >> v1:172.21.15.89:6789/0 conn(0x7f38400bad10 legacy=0x7f384014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f383ffff640 1 -- 172.21.15.6:0/1112306500 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384014abf0 con 0x7f38400b7a40 2023-12-19T13:33:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f3844b6f640 1 --2- 172.21.15.6:0/1112306500 >> v2:172.21.15.89:3300/0 conn(0x7f38401410f0 0x7f3840141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.393+0000 7f383ffff640 1 --2- 172.21.15.6:0/1112306500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400b7a40 0x7f38400b83f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f38400bbe10 tx=0x7f383002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981c4512ef871810 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f383effd640 1 -- 172.21.15.6:0/1112306500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383002f850 con 0x7f38400b7a40 2023-12-19T13:33:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f383effd640 1 -- 172.21.15.6:0/1112306500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383002f9b0 con 0x7f38400b7a40 2023-12-19T13:33:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f383effd640 1 -- 172.21.15.6:0/1112306500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383002fd40 con 0x7f38400b7a40 2023-12-19T13:33:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 -- 172.21.15.6:0/1112306500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400b7a40 msgr2=0x7f38400b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 --2- 172.21.15.6:0/1112306500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400b7a40 0x7f38400b83f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f38400bbe10 tx=0x7f383002ba30 comp rx=0 tx=0).stop 2023-12-19T13:33:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 -- 172.21.15.6:0/1112306500 shutdown_connections 2023-12-19T13:33:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 --2- 172.21.15.6:0/1112306500 >> v2:172.21.15.89:3300/0 conn(0x7f38401410f0 0x7f3840141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 --2- 172.21.15.6:0/1112306500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400b7a40 0x7f38400b83f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 -- 172.21.15.6:0/1112306500 >> 172.21.15.6:0/1112306500 conn(0x7f38400c0390 msgr2=0x7f38400c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 -- 172.21.15.6:0/1112306500 shutdown_connections 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.394+0000 7f38465d2640 1 -- 172.21.15.6:0/1112306500 wait complete. 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.395+0000 7f38465d2640 1 Processor -- start 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.395+0000 7f38465d2640 1 -- start start 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f38465d2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38400b7a40 0x7f384013b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f38465d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 0x7f3840146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f38465d2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38401410f0 0x7f3840146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f38465d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384014cd00 con 0x7f38400bad10 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f38465d2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840148310 con 0x7f38400b7a40 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f38465d2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3840147d90 con 0x7f38401410f0 2023-12-19T13:33:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 0x7f3840146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 0x7f3840146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42650/0 (socket says 172.21.15.6:42650) 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 -- 172.21.15.6:0/3246312016 learned_addr learned my addr 172.21.15.6:0/3246312016 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f3844b6f640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38401410f0 0x7f3840146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383ffff640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38400b7a40 0x7f384013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 -- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38401410f0 msgr2=0x7f3840146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38401410f0 0x7f3840146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 -- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38400b7a40 msgr2=0x7f384013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38400b7a40 0x7f384013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.396+0000 7f383f7fe640 1 -- 172.21.15.6:0/3246312016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300094d0 con 0x7f38400bad10 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.397+0000 7f383f7fe640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 0x7f3840146620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f383400c430 tx=0x7f383400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.397+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340052d0 con 0x7f38400bad10 2023-12-19T13:33:43.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.397+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834005430 con 0x7f38400bad10 2023-12-19T13:33:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.397+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834003830 con 0x7f38400bad10 2023-12-19T13:33:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.397+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384013bba0 con 0x7f38400bad10 2023-12-19T13:33:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.397+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384014bba0 con 0x7f38400bad10 2023-12-19T13:33:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.398+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3840146340 con 0x7f38400bad10 2023-12-19T13:33:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.398+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3834003990 con 0x7f38400bad10 2023-12-19T13:33:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.399+0000 7f383cff9640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f382c06a430 0x7f382c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.399+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3834087a70 con 0x7f38400bad10 2023-12-19T13:33:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.399+0000 7f383ffff640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f382c06a430 0x7f382c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.400+0000 7f383ffff640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f382c06a430 0x7f382c06c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3830036000 tx=0x7f3830008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.403+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3840146340 con 0x7f38400bad10 2023-12-19T13:33:43.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.655+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3840146340 con 0x7f38400bad10 2023-12-19T13:33:43.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.658+0000 7f383cff9640 1 -- 172.21.15.6:0/3246312016 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3840146340 con 0x7f38400bad10 2023-12-19T13:33:43.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f382c06a430 msgr2=0x7f382c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f382c06a430 0x7f382c06c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3830036000 tx=0x7f3830008030 comp rx=0 tx=0).stop 2023-12-19T13:33:43.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 msgr2=0x7f3840146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 0x7f3840146620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f383400c430 tx=0x7f383400c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 shutdown_connections 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f382c06a430 0x7f382c06c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38401410f0 0x7f3840146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38400bad10 0x7f3840146620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 --2- 172.21.15.6:0/3246312016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38400b7a40 0x7f384013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 >> 172.21.15.6:0/3246312016 conn(0x7f38400c0390 msgr2=0x7f38400bc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 shutdown_connections 2023-12-19T13:33:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.660+0000 7f38465d2640 1 -- 172.21.15.6:0/3246312016 wait complete. 2023-12-19T13:33:43.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T13:33:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.777+0000 7fdacf25f640 1 Processor -- start 2023-12-19T13:33:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacf25f640 1 -- start start 2023-12-19T13:33:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacf25f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdac80b8ec0 0x7fdac81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacf25f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac814ef70 con 0x7fdac80b7fb0 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacf25f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac80b6d30 con 0x7fdac8144dd0 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacf25f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac80b9a20 con 0x7fdac80b8ec0 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacd7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdac80b8ec0 0x7fdac81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdac7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdac80b7fb0 0x7fdac80b87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39470/0 (socket says 172.21.15.6:39470) 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdacd7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdac80b8ec0 0x7fdac81564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42652/0 (socket says 172.21.15.6:42652) 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.778+0000 7fdac7fff640 1 -- 172.21.15.6:0/1443869385 learned_addr learned my addr 172.21.15.6:0/1443869385 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.779+0000 7fdacd7fc640 1 -- 172.21.15.6:0/1443869385 >> v1:172.21.15.89:6789/0 conn(0x7fdac8144dd0 legacy=0x7fdac814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.779+0000 7fdacd7fc640 1 -- 172.21.15.6:0/1443869385 >> v1:172.21.15.6:6789/0 conn(0x7fdac80b7fb0 legacy=0x7fdac80b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.779+0000 7fdac77fe640 1 -- 172.21.15.6:0/1443869385 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970593152 0 0) 0x7fdac814ef70 con 0x7fdac80b7fb0 2023-12-19T13:33:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.779+0000 7fdacd7fc640 1 -- 172.21.15.6:0/1443869385 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80bca70 con 0x7fdac80b8ec0 2023-12-19T13:33:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.779+0000 7fdacd7fc640 1 --2- 172.21.15.6:0/1443869385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b8ec0 0x7fdac81564d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009d90 tx=0x7fdac002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d97b4ad2f506941 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdac77fe640 1 -- 172.21.15.6:0/1443869385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac002cd00 con 0x7fdac80b8ec0 2023-12-19T13:33:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdac77fe640 1 -- 172.21.15.6:0/1443869385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac002ce60 con 0x7fdac80b8ec0 2023-12-19T13:33:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdac77fe640 1 -- 172.21.15.6:0/1443869385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0034660 con 0x7fdac80b8ec0 2023-12-19T13:33:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 -- 172.21.15.6:0/1443869385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b8ec0 msgr2=0x7fdac81564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 --2- 172.21.15.6:0/1443869385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b8ec0 0x7fdac81564d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009d90 tx=0x7fdac002bf50 comp rx=0 tx=0).stop 2023-12-19T13:33:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 -- 172.21.15.6:0/1443869385 shutdown_connections 2023-12-19T13:33:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 --2- 172.21.15.6:0/1443869385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b8ec0 0x7fdac81564d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 -- 172.21.15.6:0/1443869385 >> 172.21.15.6:0/1443869385 conn(0x7fdac80c03d0 msgr2=0x7fdac80c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 -- 172.21.15.6:0/1443869385 shutdown_connections 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.780+0000 7fdacf25f640 1 -- 172.21.15.6:0/1443869385 wait complete. 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.781+0000 7fdacf25f640 1 Processor -- start 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.781+0000 7fdacf25f640 1 -- start start 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacf25f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 0x7fdac8147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacf25f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac80b8ec0 0x7fdac80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacf25f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8144dd0 0x7fdac80b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacf25f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac8148260 con 0x7fdac80b7fb0 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacf25f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac8148910 con 0x7fdac80b8ec0 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacf25f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac814b380 con 0x7fdac8144dd0 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 0x7fdac8147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 0x7fdac8147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42658/0 (socket says 172.21.15.6:42658) 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 -- 172.21.15.6:0/2849361928 learned_addr learned my addr 172.21.15.6:0/2849361928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdacd7fc640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8144dd0 0x7fdac80b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdac7fff640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac80b8ec0 0x7fdac80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 -- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8144dd0 msgr2=0x7fdac80b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8144dd0 0x7fdac80b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 -- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac80b8ec0 msgr2=0x7fdac80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.782+0000 7fdaccffb640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac80b8ec0 0x7fdac80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdaccffb640 1 -- 172.21.15.6:0/2849361928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0009a70 con 0x7fdac80b7fb0 2023-12-19T13:33:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdac7fff640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac80b8ec0 0x7fdac80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdaccffb640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 0x7fdac8147d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00b3f0 tx=0x7fdabc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011830 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc011990 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac81442e0 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011d40 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.783+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac81469d0 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.784+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac8144140 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.784+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdabc01a400 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.785+0000 7fdac57fa640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdaac06a430 0x7fdaac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.785+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdabc0884b0 con 0x7fdac80b7fb0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.785+0000 7fdac7fff640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdaac06a430 0x7fdaac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.785+0000 7fdac7fff640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdaac06a430 0x7fdaac06c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdac8143f00 tx=0x7fdab4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:43.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:43.789+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdac8144140 con 0x7fdac80b7fb0 2023-12-19T13:33:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.036+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdac8066630 con 0x7fdac80b7fb0 2023-12-19T13:33:44.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.040+0000 7fdac57fa640 1 -- 172.21.15.6:0/2849361928 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdabc053d50 con 0x7fdac80b7fb0 2023-12-19T13:33:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdaac06a430 msgr2=0x7fdaac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdaac06a430 0x7fdaac06c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdac8143f00 tx=0x7fdab4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 msgr2=0x7fdac8147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 0x7fdac8147d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00b3f0 tx=0x7fdabc00b8b0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 shutdown_connections 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fdaac06a430 0x7fdaac06c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8144dd0 0x7fdac80b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac80b8ec0 0x7fdac80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 --2- 172.21.15.6:0/2849361928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdac80b7fb0 0x7fdac8147d20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 >> 172.21.15.6:0/2849361928 conn(0x7fdac80c03d0 msgr2=0x7fdac80b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 shutdown_connections 2023-12-19T13:33:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.042+0000 7fdacf25f640 1 -- 172.21.15.6:0/2849361928 wait complete. 2023-12-19T13:33:44.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T13:33:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.159+0000 7f1364139640 1 Processor -- start 2023-12-19T13:33:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.159+0000 7f1364139640 1 -- start start 2023-12-19T13:33:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1364139640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c144dd0 0x7f135c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1364139640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f135c0b7fb0 0x7f135c0b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1364139640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f135c14e670 0x7f135c0b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1364139640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c0b9a20 con 0x7f135c14e670 2023-12-19T13:33:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1364139640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c14ef70 con 0x7f135c0b7fb0 2023-12-19T13:33:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1364139640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b6d30 con 0x7f135c144dd0 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f135c14e670 0x7f135c0b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f135c14e670 0x7f135c0b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42672/0 (socket says 172.21.15.6:42672) 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 -- 172.21.15.6:0/4009511189 learned_addr learned my addr 172.21.15.6:0/4009511189 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f1361ed5640 1 --2- 172.21.15.6:0/4009511189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c144dd0 0x7f135c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 -- 172.21.15.6:0/4009511189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c144dd0 msgr2=0x7f135c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13616d4640 1 --2- 172.21.15.6:0/4009511189 >> v2:172.21.15.89:3300/0 conn(0x7f135c0b7fb0 0x7f135c0b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 --2- 172.21.15.6:0/4009511189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c144dd0 0x7f135c14e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 -- 172.21.15.6:0/4009511189 >> v2:172.21.15.89:3300/0 conn(0x7f135c0b7fb0 msgr2=0x7f135c0b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 --2- 172.21.15.6:0/4009511189 >> v2:172.21.15.89:3300/0 conn(0x7f135c0b7fb0 0x7f135c0b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13626d6640 1 -- 172.21.15.6:0/4009511189 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0bca70 con 0x7f135c14e670 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.160+0000 7f13616d4640 1 --2- 172.21.15.6:0/4009511189 >> v2:172.21.15.89:3300/0 conn(0x7f135c0b7fb0 0x7f135c0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.161+0000 7f13626d6640 1 --2- 172.21.15.6:0/4009511189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c14e670 0x7f135c0b8cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f135c0722e0 tx=0x7f134c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de62dcf5dfa935b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.161+0000 7f1360ed3640 1 -- 172.21.15.6:0/4009511189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c02cb00 con 0x7f135c14e670 2023-12-19T13:33:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.161+0000 7f1360ed3640 1 -- 172.21.15.6:0/4009511189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c02cc60 con 0x7f135c14e670 2023-12-19T13:33:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.161+0000 7f1360ed3640 1 -- 172.21.15.6:0/4009511189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0343f0 con 0x7f135c14e670 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 -- 172.21.15.6:0/4009511189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c14e670 msgr2=0x7f135c0b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 --2- 172.21.15.6:0/4009511189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c14e670 0x7f135c0b8cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f135c0722e0 tx=0x7f134c02bf60 comp rx=0 tx=0).stop 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 -- 172.21.15.6:0/4009511189 shutdown_connections 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 --2- 172.21.15.6:0/4009511189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c14e670 0x7f135c0b8cf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 --2- 172.21.15.6:0/4009511189 >> v2:172.21.15.89:3300/0 conn(0x7f135c0b7fb0 0x7f135c0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 --2- 172.21.15.6:0/4009511189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c144dd0 0x7f135c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 -- 172.21.15.6:0/4009511189 >> 172.21.15.6:0/4009511189 conn(0x7f135c0c03d0 msgr2=0x7f135c0c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 -- 172.21.15.6:0/4009511189 shutdown_connections 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.162+0000 7f1364139640 1 -- 172.21.15.6:0/4009511189 wait complete. 2023-12-19T13:33:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.163+0000 7f1364139640 1 Processor -- start 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.163+0000 7f1364139640 1 -- start start 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1364139640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0b7fb0 0x7f135c146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1364139640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 0x7f135c14d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1364139640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c14e670 0x7f135c1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1364139640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c14da70 con 0x7f135c144dd0 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1364139640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c1481a0 con 0x7f135c14e670 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1364139640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c14a9d0 con 0x7f135c0b7fb0 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 0x7f135c14d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 0x7f135c14d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42684/0 (socket says 172.21.15.6:42684) 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 -- 172.21.15.6:0/3167229005 learned_addr learned my addr 172.21.15.6:0/3167229005 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f1361ed5640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0b7fb0 0x7f135c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13626d6640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c14e670 0x7f135c1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 -- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0b7fb0 msgr2=0x7f135c146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0b7fb0 0x7f135c146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 -- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c14e670 msgr2=0x7f135c1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c14e670 0x7f135c1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 -- 172.21.15.6:0/3167229005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c009b30 con 0x7f135c144dd0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.164+0000 7f13616d4640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 0x7f135c14d530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f135000c7f0 tx=0x7f135000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.165+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350007820 con 0x7f135c144dd0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.165+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1350007980 con 0x7f135c144dd0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.165+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c14a350 con 0x7f135c144dd0 2023-12-19T13:33:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.165+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350007d30 con 0x7f135c144dd0 2023-12-19T13:33:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.165+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c14b990 con 0x7f135c144dd0 2023-12-19T13:33:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.166+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c073a40 con 0x7f135c144dd0 2023-12-19T13:33:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.166+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f13500113f0 con 0x7f135c144dd0 2023-12-19T13:33:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.167+0000 7f135a7fc640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f134806a460 0x7f134806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.167+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13500888b0 con 0x7f135c144dd0 2023-12-19T13:33:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.167+0000 7f1361ed5640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f134806a460 0x7f134806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.167+0000 7f1361ed5640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f134806a460 0x7f134806c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f135400aac0 tx=0x7f1354008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.171+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1350054190 con 0x7f135c144dd0 2023-12-19T13:33:44.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.413+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f135c0b4100 con 0x7f135c144dd0 2023-12-19T13:33:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.417+0000 7f135a7fc640 1 -- 172.21.15.6:0/3167229005 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f135001f0a0 con 0x7f135c144dd0 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.418+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f134806a460 msgr2=0x7f134806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f134806a460 0x7f134806c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f135400aac0 tx=0x7f1354008040 comp rx=0 tx=0).stop 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 msgr2=0x7f135c14d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 0x7f135c14d530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f135000c7f0 tx=0x7f135000ccb0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 shutdown_connections 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f134806a460 0x7f134806c920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c14e670 0x7f135c1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f135c144dd0 0x7f135c14d530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 --2- 172.21.15.6:0/3167229005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0b7fb0 0x7f135c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 >> 172.21.15.6:0/3167229005 conn(0x7f135c0c03d0 msgr2=0x7f135c0bef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 shutdown_connections 2023-12-19T13:33:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.419+0000 7f1364139640 1 -- 172.21.15.6:0/3167229005 wait complete. 2023-12-19T13:33:44.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T13:33:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.535+0000 7f6153223640 1 Processor -- start 2023-12-19T13:33:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.535+0000 7f6153223640 1 -- start start 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f6153223640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f614c142f20 0x7f614c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f6153223640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f614c0b94b0 0x7f614c153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f6153223640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c1498f0 con 0x7f614c0a0cc0 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f6153223640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c0b37e0 con 0x7f614c142f20 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f6153223640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c148fc0 con 0x7f614c0b94b0 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f6150fbf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f614c142f20 0x7f614c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f614bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f614c0a0cc0 0x7f614c0b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39486/0 (socket says 172.21.15.6:39486) 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f614bfff640 1 -- 172.21.15.6:0/895902448 learned_addr learned my addr 172.21.15.6:0/895902448 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.536+0000 7f61517c0640 1 --2- 172.21.15.6:0/895902448 >> v2:172.21.15.89:3300/0 conn(0x7f614c0b94b0 0x7f614c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f6150fbf640 1 -- 172.21.15.6:0/895902448 >> v2:172.21.15.89:3300/0 conn(0x7f614c0b94b0 msgr2=0x7f614c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f6150fbf640 1 --2- 172.21.15.6:0/895902448 >> v2:172.21.15.89:3300/0 conn(0x7f614c0b94b0 0x7f614c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f6150fbf640 1 -- 172.21.15.6:0/895902448 >> v1:172.21.15.6:6789/0 conn(0x7f614c0a0cc0 legacy=0x7f614c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f6150fbf640 1 -- 172.21.15.6:0/895902448 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c1492a0 con 0x7f614c142f20 2023-12-19T13:33:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f614b7fe640 1 -- 172.21.15.6:0/895902448 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660913174 0 0) 0x7f614c1498f0 con 0x7f614c0a0cc0 2023-12-19T13:33:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f6150fbf640 1 --2- 172.21.15.6:0/895902448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c142f20 0x7f614c0b4290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f614c067020 tx=0x7f614002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78488bbbe4ab51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.537+0000 7f614b7fe640 1 -- 172.21.15.6:0/895902448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140030610 con 0x7f614c142f20 2023-12-19T13:33:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f614b7fe640 1 -- 172.21.15.6:0/895902448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140030770 con 0x7f614c142f20 2023-12-19T13:33:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f614b7fe640 1 -- 172.21.15.6:0/895902448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140030b00 con 0x7f614c142f20 2023-12-19T13:33:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 -- 172.21.15.6:0/895902448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c142f20 msgr2=0x7f614c0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 --2- 172.21.15.6:0/895902448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c142f20 0x7f614c0b4290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f614c067020 tx=0x7f614002b960 comp rx=0 tx=0).stop 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 -- 172.21.15.6:0/895902448 shutdown_connections 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 --2- 172.21.15.6:0/895902448 >> v2:172.21.15.89:3300/0 conn(0x7f614c0b94b0 0x7f614c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 --2- 172.21.15.6:0/895902448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c142f20 0x7f614c0b4290 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 -- 172.21.15.6:0/895902448 >> 172.21.15.6:0/895902448 conn(0x7f614c0be1e0 msgr2=0x7f614c0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 -- 172.21.15.6:0/895902448 shutdown_connections 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.538+0000 7f6153223640 1 -- 172.21.15.6:0/895902448 wait complete. 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.539+0000 7f6153223640 1 Processor -- start 2023-12-19T13:33:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.539+0000 7f6153223640 1 -- start start 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6153223640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614c0a0cc0 0x7f614c0a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6153223640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 0x7f614c1ddf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6153223640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614c142f20 0x7f614c1de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6153223640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0a32c0 con 0x7f614c0b94b0 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6153223640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0bdca0 con 0x7f614c142f20 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6153223640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0bd6f0 con 0x7f614c0a0cc0 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 0x7f614c1ddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 0x7f614c1ddf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42702/0 (socket says 172.21.15.6:42702) 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 -- 172.21.15.6:0/736000778 learned_addr learned my addr 172.21.15.6:0/736000778 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f61517c0640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614c142f20 0x7f614c1de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6150fbf640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614c0a0cc0 0x7f614c0a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 -- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614c0a0cc0 msgr2=0x7f614c0a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614c0a0cc0 0x7f614c0a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 -- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614c142f20 msgr2=0x7f614c1de4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614c142f20 0x7f614c1de4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f614bfff640 1 -- 172.21.15.6:0/736000778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009400 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.540+0000 7f6150fbf640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614c0a0cc0 0x7f614c0a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.541+0000 7f614bfff640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 0x7f614c1ddf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f613800c4b0 tx=0x7f613800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.541+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380074e0 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.541+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6138007660 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.541+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c0a1640 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.541+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138004a20 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.541+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c0bdeb0 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.542+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c066e90 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.542+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6138004b80 con 0x7f614c0b94b0 2023-12-19T13:33:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.543+0000 7f61497fa640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f613006a430 0x7f613006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.543+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6138087a00 con 0x7f614c0b94b0 2023-12-19T13:33:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.543+0000 7f6150fbf640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f613006a430 0x7f613006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.543+0000 7f6150fbf640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f613006a430 0x7f613006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6140036000 tx=0x7f6140008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.547+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6138053540 con 0x7f614c0b94b0 2023-12-19T13:33:44.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.790+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f614c073a40 con 0x7f614c0b94b0 2023-12-19T13:33:44.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.794+0000 7f61497fa640 1 -- 172.21.15.6:0/736000778 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f61380180a0 con 0x7f614c0b94b0 2023-12-19T13:33:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.796+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f613006a430 msgr2=0x7f613006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f613006a430 0x7f613006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6140036000 tx=0x7f6140008030 comp rx=0 tx=0).stop 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 msgr2=0x7f614c1ddf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 0x7f614c1ddf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f613800c4b0 tx=0x7f613800c970 comp rx=0 tx=0).stop 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 shutdown_connections 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f613006a430 0x7f613006c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614c142f20 0x7f614c1de4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f614c0b94b0 0x7f614c1ddf80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 --2- 172.21.15.6:0/736000778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614c0a0cc0 0x7f614c0a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 >> 172.21.15.6:0/736000778 conn(0x7f614c0be1e0 msgr2=0x7f614c140740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 shutdown_connections 2023-12-19T13:33:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.797+0000 7f6153223640 1 -- 172.21.15.6:0/736000778 wait complete. 2023-12-19T13:33:44.809 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:44.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.913+0000 7fe68fdab640 1 Processor -- start 2023-12-19T13:33:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 -- start start 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6880ba3a0 0x7fe68806f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe68814ca90 0x7fe68806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6880b46e0 0x7fe6880b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880ba780 con 0x7fe68814ca90 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68806f900 con 0x7fe6880b46e0 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68fdab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68814c600 con 0x7fe6880ba3a0 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68d346640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe68814ca90 0x7fe68806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68d346640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe68814ca90 0x7fe68806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42710/0 (socket says 172.21.15.6:42710) 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.914+0000 7fe68d346640 1 -- 172.21.15.6:0/1858305452 learned_addr learned my addr 172.21.15.6:0/1858305452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68db47640 1 --2- 172.21.15.6:0/1858305452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6880ba3a0 0x7fe68806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68e348640 1 --2- 172.21.15.6:0/1858305452 >> v2:172.21.15.89:3300/0 conn(0x7fe6880b46e0 0x7fe6880b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68d346640 1 -- 172.21.15.6:0/1858305452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6880ba3a0 msgr2=0x7fe68806f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68d346640 1 --2- 172.21.15.6:0/1858305452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6880ba3a0 0x7fe68806f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68d346640 1 -- 172.21.15.6:0/1858305452 >> v2:172.21.15.89:3300/0 conn(0x7fe6880b46e0 msgr2=0x7fe6880b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68d346640 1 --2- 172.21.15.6:0/1858305452 >> v2:172.21.15.89:3300/0 conn(0x7fe6880b46e0 0x7fe6880b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68d346640 1 -- 172.21.15.6:0/1858305452 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68814bfb0 con 0x7fe68814ca90 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68e348640 1 --2- 172.21.15.6:0/1858305452 >> v2:172.21.15.89:3300/0 conn(0x7fe6880b46e0 0x7fe6880b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.915+0000 7fe68d346640 1 --2- 172.21.15.6:0/1858305452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe68814ca90 0x7fe68806d7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe688070cc0 tx=0x7fe67802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1012635412029e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68cb45640 1 -- 172.21.15.6:0/1858305452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678031870 con 0x7fe68814ca90 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68cb45640 1 -- 172.21.15.6:0/1858305452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6780319d0 con 0x7fe68814ca90 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68cb45640 1 -- 172.21.15.6:0/1858305452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678031d60 con 0x7fe68814ca90 2023-12-19T13:33:44.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 -- 172.21.15.6:0/1858305452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe68814ca90 msgr2=0x7fe68806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1858305452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe68814ca90 0x7fe68806d7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe688070cc0 tx=0x7fe67802b910 comp rx=0 tx=0).stop 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 -- 172.21.15.6:0/1858305452 shutdown_connections 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1858305452 >> v2:172.21.15.89:3300/0 conn(0x7fe6880b46e0 0x7fe6880b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1858305452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe68814ca90 0x7fe68806d7b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1858305452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6880ba3a0 0x7fe68806f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 -- 172.21.15.6:0/1858305452 >> 172.21.15.6:0/1858305452 conn(0x7fe6880bac30 msgr2=0x7fe6880bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 -- 172.21.15.6:0/1858305452 shutdown_connections 2023-12-19T13:33:44.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.916+0000 7fe68fdab640 1 -- 172.21.15.6:0/1858305452 wait complete. 2023-12-19T13:33:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.917+0000 7fe68fdab640 1 Processor -- start 2023-12-19T13:33:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.917+0000 7fe68fdab640 1 -- start start 2023-12-19T13:33:44.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68fdab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6880b46e0 0x7fe6881421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68fdab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 0x7fe688143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68fdab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe68814ca90 0x7fe6881e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68fdab640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6881426e0 con 0x7fe6880ba3a0 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68fdab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68806c270 con 0x7fe6880b46e0 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68fdab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68806c830 con 0x7fe68814ca90 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 0x7fe688143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 0x7fe688143bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42714/0 (socket says 172.21.15.6:42714) 2023-12-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 -- 172.21.15.6:0/1134796695 learned_addr learned my addr 172.21.15.6:0/1134796695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68e348640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe68814ca90 0x7fe6881e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68db47640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6880b46e0 0x7fe6881421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 -- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe68814ca90 msgr2=0x7fe6881e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe68814ca90 0x7fe6881e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 -- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6880b46e0 msgr2=0x7fe6881421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6880b46e0 0x7fe6881421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 -- 172.21.15.6:0/1134796695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780094d0 con 0x7fe6880ba3a0 2023-12-19T13:33:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.918+0000 7fe68d346640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 0x7fe688143bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe67802b950 tx=0x7fe6780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.919+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67803ad30 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.919+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6780443f0 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.919+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe688144400 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.919+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6780447a0 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.919+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6880b6ea0 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.920+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe688073a40 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.920+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe67804d450 con 0x7fe6880ba3a0 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.921+0000 7fe67e7fc640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe66c06a430 0x7fe66c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.921+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe67802d040 con 0x7fe6880ba3a0 2023-12-19T13:33:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.921+0000 7fe68db47640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe66c06a430 0x7fe66c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.921+0000 7fe68db47640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe66c06a430 0x7fe66c06c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe680006fd0 tx=0x7fe680008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:44.925+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe678076420 con 0x7fe6880ba3a0 2023-12-19T13:33:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.104+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe68806ec50 con 0x7fe6880ba3a0 2023-12-19T13:33:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.105+0000 7fe67e7fc640 1 -- 172.21.15.6:0/1134796695 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12293 (secure 0 0 0) 0x7fe678035020 con 0x7fe6880ba3a0 2023-12-19T13:33:45.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:45.107 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:42.121410+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe66c06a430 msgr2=0x7fe66c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe66c06a430 0x7fe66c06c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe680006fd0 tx=0x7fe680008040 comp rx=0 tx=0).stop 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 msgr2=0x7fe688143bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 0x7fe688143bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe67802b950 tx=0x7fe6780046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 shutdown_connections 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe66c06a430 0x7fe66c06c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe68814ca90 0x7fe6881e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6880ba3a0 0x7fe688143bd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 --2- 172.21.15.6:0/1134796695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6880b46e0 0x7fe6881421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 >> 172.21.15.6:0/1134796695 conn(0x7fe6880bac30 msgr2=0x7fe68814abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 shutdown_connections 2023-12-19T13:33:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.107+0000 7fe68fdab640 1 -- 172.21.15.6:0/1134796695 wait complete. 2023-12-19T13:33:45.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T13:33:45.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T13:33:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.226+0000 7f4b0d6f7640 1 Processor -- start 2023-12-19T13:33:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.226+0000 7f4b0d6f7640 1 -- start start 2023-12-19T13:33:45.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b0d6f7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b0806b9d0 0x7f4b0806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b0d6f7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4b0806bdb0 0x7f4b0806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b0d6f7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0806eae0 con 0x7f4b0806f4c0 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b0d6f7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0806cee0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b0d6f7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0814e100 con 0x7f4b0806bdb0 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b0806b9d0 0x7f4b0806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b0806b9d0 0x7f4b0806c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42722/0 (socket says 172.21.15.6:42722) 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 -- 172.21.15.6:0/1240909850 learned_addr learned my addr 172.21.15.6:0/1240909850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b067fc640 1 --2- 172.21.15.6:0/1240909850 >> v2:172.21.15.89:3300/0 conn(0x7f4b0806bdb0 0x7f4b0806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 -- 172.21.15.6:0/1240909850 >> v2:172.21.15.89:3300/0 conn(0x7f4b0806bdb0 msgr2=0x7f4b0806ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 --2- 172.21.15.6:0/1240909850 >> v2:172.21.15.89:3300/0 conn(0x7f4b0806bdb0 0x7f4b0806ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 -- 172.21.15.6:0/1240909850 >> v1:172.21.15.89:6789/0 conn(0x7f4b0806f4c0 legacy=0x7f4b0814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b06ffd640 1 -- 172.21.15.6:0/1240909850 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0806e6c0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.227+0000 7f4b067fc640 1 --2- 172.21.15.6:0/1240909850 >> v2:172.21.15.89:3300/0 conn(0x7f4b0806bdb0 0x7f4b0806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.228+0000 7f4b06ffd640 1 --2- 172.21.15.6:0/1240909850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0806c9a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4b0806ac30 tx=0x7f4b0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffa9ce59cbc860 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.228+0000 7f4b05ffb640 1 -- 172.21.15.6:0/1240909850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00031870 con 0x7f4b0806b9d0 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.228+0000 7f4b05ffb640 1 -- 172.21.15.6:0/1240909850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000319d0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.228+0000 7f4b05ffb640 1 -- 172.21.15.6:0/1240909850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00031d60 con 0x7f4b0806b9d0 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/1240909850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 msgr2=0x7f4b0806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/1240909850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0806c9a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4b0806ac30 tx=0x7f4b0002b910 comp rx=0 tx=0).stop 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/1240909850 shutdown_connections 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/1240909850 >> v2:172.21.15.89:3300/0 conn(0x7f4b0806bdb0 0x7f4b0806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/1240909850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0806c9a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/1240909850 >> 172.21.15.6:0/1240909850 conn(0x7f4b080be1e0 msgr2=0x7f4b080be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/1240909850 shutdown_connections 2023-12-19T13:33:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.229+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/1240909850 wait complete. 2023-12-19T13:33:45.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.230+0000 7f4b0d6f7640 1 Processor -- start 2023-12-19T13:33:45.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.230+0000 7f4b0d6f7640 1 -- start start 2023-12-19T13:33:45.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b0d6f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b0d6f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b0806bdb0 0x7f4b081e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b0d6f7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b0806f4c0 0x7f4b080a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b0d6f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081e49e0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b0d6f7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0814b7a0 con 0x7f4b0806bdb0 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b0d6f7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081e41b0 con 0x7f4b0806f4c0 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0814b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42724/0 (socket says 172.21.15.6:42724) 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 -- 172.21.15.6:0/999537410 learned_addr learned my addr 172.21.15.6:0/999537410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b067fc640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b0806bdb0 0x7f4b081e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b077fe640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b0806f4c0 0x7f4b080a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 -- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b0806f4c0 msgr2=0x7f4b080a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b0806f4c0 0x7f4b080a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 -- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b0806bdb0 msgr2=0x7f4b081e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b0806bdb0 0x7f4b081e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 -- 172.21.15.6:0/999537410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b000094d0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4b06ffd640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0814b260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b00000c00 tx=0x7f4b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.231+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00031840 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.232+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000443f0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.232+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b081483c0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.232+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000447a0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.232+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b081e44d0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.233+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b081e42f0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.233+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b0004d450 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.233+0000 7f4aff7fe640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4ae806a430 0x7f4ae806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.234+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b0002d040 con 0x7f4b0806b9d0 2023-12-19T13:33:45.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.234+0000 7f4b067fc640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4ae806a430 0x7f4ae806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.234+0000 7f4b067fc640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4ae806a430 0x7f4ae806c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4b080bc8a0 tx=0x7f4af0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.238+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b000765c0 con 0x7f4b0806b9d0 2023-12-19T13:33:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.413+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b08066e90 con 0x7f4b0806b9d0 2023-12-19T13:33:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.413+0000 7f4aff7fe640 1 -- 172.21.15.6:0/999537410 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b00035020 con 0x7f4b0806b9d0 2023-12-19T13:33:45.415 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4ae806a430 msgr2=0x7f4ae806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4ae806a430 0x7f4ae806c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4b080bc8a0 tx=0x7f4af0008040 comp rx=0 tx=0).stop 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 msgr2=0x7f4b0814b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0814b260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b00000c00 tx=0x7f4b000046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 shutdown_connections 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4ae806a430 0x7f4ae806c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b0806f4c0 0x7f4b080a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b0806bdb0 0x7f4b081e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 --2- 172.21.15.6:0/999537410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b0806b9d0 0x7f4b0814b260 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 >> 172.21.15.6:0/999537410 conn(0x7f4b080be1e0 msgr2=0x7f4b080b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 shutdown_connections 2023-12-19T13:33:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.415+0000 7f4b0d6f7640 1 -- 172.21.15.6:0/999537410 wait complete. 2023-12-19T13:33:45.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T13:33:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.531+0000 7fcc0784c640 1 Processor -- start 2023-12-19T13:33:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.531+0000 7fcc0784c640 1 -- start start 2023-12-19T13:33:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc0784c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcc000b79f0 0x7fcc000bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc0784c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000bacc0 con 0x7fcc00140ef0 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc0784c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000bbe60 con 0x7fcc0014aa00 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc0784c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000bbca0 con 0x7fcc000b79f0 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc05de9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcc00140ef0 0x7fcc00141380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39496/0 (socket says 172.21.15.6:39496) 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc05de9640 1 -- 172.21.15.6:0/1692671701 learned_addr learned my addr 172.21.15.6:0/1692671701 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc055e8640 1 --2- 172.21.15.6:0/1692671701 >> v2:172.21.15.89:3300/0 conn(0x7fcc000b79f0 0x7fcc000bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850238661 0 0) 0x7fcc000bacc0 con 0x7fcc00140ef0 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbec003520 con 0x7fcc00140ef0 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105805883 0 0) 0x7fcc000bbe60 con 0x7fcc0014aa00 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc000bacc0 con 0x7fcc0014aa00 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992049984 0 0) 0x7fcbec003520 con 0x7fcc00140ef0 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc055e8640 1 -- 172.21.15.6:0/1692671701 >> v1:172.21.15.89:6789/0 conn(0x7fcc0014aa00 legacy=0x7fcc000b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc055e8640 1 -- 172.21.15.6:0/1692671701 >> v1:172.21.15.6:6789/0 conn(0x7fcc00140ef0 legacy=0x7fcc00141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.532+0000 7fcc055e8640 1 -- 172.21.15.6:0/1692671701 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000b8bc0 con 0x7fcc000b79f0 2023-12-19T13:33:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.533+0000 7fcc055e8640 1 --2- 172.21.15.6:0/1692671701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc000bb760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0097a0 tx=0x7fcbfc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d962635a2f676ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.533+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80019f0 con 0x7fcc000b79f0 2023-12-19T13:33:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.533+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc031590 con 0x7fcc000b79f0 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.533+0000 7fcbf7fff640 1 -- 172.21.15.6:0/1692671701 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc031900 con 0x7fcc000b79f0 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 -- 172.21.15.6:0/1692671701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 msgr2=0x7fcc000bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 --2- 172.21.15.6:0/1692671701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc000bb760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0097a0 tx=0x7fcbfc02b8b0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 -- 172.21.15.6:0/1692671701 shutdown_connections 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 --2- 172.21.15.6:0/1692671701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc000bb760 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 -- 172.21.15.6:0/1692671701 >> 172.21.15.6:0/1692671701 conn(0x7fcc000c0340 msgr2=0x7fcc000c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 -- 172.21.15.6:0/1692671701 shutdown_connections 2023-12-19T13:33:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.534+0000 7fcc0784c640 1 -- 172.21.15.6:0/1692671701 wait complete. 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.535+0000 7fcc0784c640 1 Processor -- start 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.535+0000 7fcc0784c640 1 -- start start 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc0784c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc0013b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc0784c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 0x7fcc001e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc0784c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc0014aa00 0x7fcc000bf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc0784c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0013bb40 con 0x7fcc00140ef0 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc0784c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00145570 con 0x7fcc000b79f0 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc0784c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc001e3120 con 0x7fcc0014aa00 2023-12-19T13:33:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 0x7fcc001e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 0x7fcc001e35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42728/0 (socket says 172.21.15.6:42728) 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 -- 172.21.15.6:0/3635392193 learned_addr learned my addr 172.21.15.6:0/3635392193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc055e8640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc0013b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc05de9640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc0014aa00 0x7fcc000bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 -- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc0014aa00 msgr2=0x7fcc000bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc0014aa00 0x7fcc000bf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 -- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 msgr2=0x7fcc0013b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc0013b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 -- 172.21.15.6:0/3635392193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc009400 con 0x7fcc00140ef0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc05de9640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc0014aa00 0x7fcc000bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.536+0000 7fcc04de7640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 0x7fcc001e35b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c430 tx=0x7fcbf000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.537+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00052d0 con 0x7fcc00140ef0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.537+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0005450 con 0x7fcc00140ef0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.537+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0014e6d0 con 0x7fcc00140ef0 2023-12-19T13:33:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.537+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0003830 con 0x7fcc00140ef0 2023-12-19T13:33:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.537+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0014e9b0 con 0x7fcc00140ef0 2023-12-19T13:33:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.538+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc00073a40 con 0x7fcc00140ef0 2023-12-19T13:33:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.538+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbf0003990 con 0x7fcc00140ef0 2023-12-19T13:33:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.539+0000 7fcbf5ffb640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcbe406a430 0x7fcbe406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.539+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcbf0087b50 con 0x7fcc00140ef0 2023-12-19T13:33:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.539+0000 7fcc055e8640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcbe406a430 0x7fcbe406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.539+0000 7fcc055e8640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcbe406a430 0x7fcbe406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc036000 tx=0x7fcbfc03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.543+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbf0053540 con 0x7fcc00140ef0 2023-12-19T13:33:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.718+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcc000bcb60 con 0x7fcc00140ef0 2023-12-19T13:33:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.719+0000 7fcbf5ffb640 1 -- 172.21.15.6:0/3635392193 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcbf0056b60 con 0x7fcc00140ef0 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-12-19T13:33:45.721 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcbe406a430 msgr2=0x7fcbe406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcbe406a430 0x7fcbe406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc036000 tx=0x7fcbfc03d040 comp rx=0 tx=0).stop 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 msgr2=0x7fcc001e35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 0x7fcc001e35b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c430 tx=0x7fcbf000c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 shutdown_connections 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcbe406a430 0x7fcbe406c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc0014aa00 0x7fcc000bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc00140ef0 0x7fcc001e35b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 --2- 172.21.15.6:0/3635392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc000b79f0 0x7fcc0013b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 >> 172.21.15.6:0/3635392193 conn(0x7fcc000c0340 msgr2=0x7fcc000bd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.720+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 shutdown_connections 2023-12-19T13:33:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.721+0000 7fcc0784c640 1 -- 172.21.15.6:0/3635392193 wait complete. 2023-12-19T13:33:45.733 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T13:33:45.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T13:33:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.841+0000 7fca8e527640 1 Processor -- start 2023-12-19T13:33:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.841+0000 7fca8e527640 1 -- start start 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.841+0000 7fca8e527640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca880b8690 0x7fca880b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.841+0000 7fca8e527640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8814ab10 con 0x7fca88144d80 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca8e527640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8806c2f0 con 0x7fca880b77d0 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca8e527640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca880ba620 con 0x7fca880b8690 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca8cac4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fca88144d80 0x7fca8814afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39510/0 (socket says 172.21.15.6:39510) 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca8cac4640 1 -- 172.21.15.6:0/1366004460 learned_addr learned my addr 172.21.15.6:0/1366004460 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca87fff640 1 --2- 172.21.15.6:0/1366004460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca880b8690 0x7fca880b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca86ffd640 1 -- 172.21.15.6:0/1366004460 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642866565 0 0) 0x7fca8814ab10 con 0x7fca88144d80 2023-12-19T13:33:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca86ffd640 1 -- 172.21.15.6:0/1366004460 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca70003520 con 0x7fca88144d80 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca87fff640 1 -- 172.21.15.6:0/1366004460 >> v1:172.21.15.89:6789/0 conn(0x7fca880b77d0 legacy=0x7fca88144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca87fff640 1 -- 172.21.15.6:0/1366004460 >> v1:172.21.15.6:6789/0 conn(0x7fca88144d80 legacy=0x7fca8814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca86ffd640 1 -- 172.21.15.6:0/1366004460 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246675259 0 0) 0x7fca8806c2f0 con 0x7fca880b77d0 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.842+0000 7fca87fff640 1 -- 172.21.15.6:0/1366004460 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880b9e60 con 0x7fca880b8690 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.843+0000 7fca87fff640 1 --2- 172.21.15.6:0/1366004460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca880b8690 0x7fca880b8a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca780097d0 tx=0x7fca7802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a147c5d258fc5753 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.843+0000 7fca86ffd640 1 -- 172.21.15.6:0/1366004460 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78031800 con 0x7fca880b8690 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.843+0000 7fca86ffd640 1 -- 172.21.15.6:0/1366004460 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78031960 con 0x7fca880b8690 2023-12-19T13:33:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.843+0000 7fca86ffd640 1 -- 172.21.15.6:0/1366004460 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78031cf0 con 0x7fca880b8690 2023-12-19T13:33:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.843+0000 7fca8e527640 1 -- 172.21.15.6:0/1366004460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca880b8690 msgr2=0x7fca880b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.843+0000 7fca8e527640 1 --2- 172.21.15.6:0/1366004460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca880b8690 0x7fca880b8a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca780097d0 tx=0x7fca7802b8a0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.844+0000 7fca8e527640 1 -- 172.21.15.6:0/1366004460 shutdown_connections 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.844+0000 7fca8e527640 1 --2- 172.21.15.6:0/1366004460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca880b8690 0x7fca880b8a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.844+0000 7fca8e527640 1 -- 172.21.15.6:0/1366004460 >> 172.21.15.6:0/1366004460 conn(0x7fca8806b6a0 msgr2=0x7fca8806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.844+0000 7fca8e527640 1 -- 172.21.15.6:0/1366004460 shutdown_connections 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.844+0000 7fca8e527640 1 -- 172.21.15.6:0/1366004460 wait complete. 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.845+0000 7fca8e527640 1 Processor -- start 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.845+0000 7fca8e527640 1 -- start start 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.845+0000 7fca8e527640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca880b77d0 0x7fca8813ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.845+0000 7fca8e527640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 0x7fca880be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.845+0000 7fca8e527640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca88144d80 0x7fca881e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.845+0000 7fca8e527640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88140440 con 0x7fca880b8690 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca8e527640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca881d5170 con 0x7fca880b77d0 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca8e527640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca881d5f80 con 0x7fca88144d80 2023-12-19T13:33:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 0x7fca880be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 0x7fca880be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42736/0 (socket says 172.21.15.6:42736) 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 -- 172.21.15.6:0/3831266627 learned_addr learned my addr 172.21.15.6:0/3831266627 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca87fff640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca880b77d0 0x7fca8813ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca8cac4640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca88144d80 0x7fca881e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 -- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca88144d80 msgr2=0x7fca881e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca88144d80 0x7fca881e2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 -- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca880b77d0 msgr2=0x7fca8813ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca880b77d0 0x7fca8813ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 -- 172.21.15.6:0/3831266627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78009400 con 0x7fca880b8690 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca87fff640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca880b77d0 0x7fca8813ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca8cac4640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca88144d80 0x7fca881e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca877fe640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 0x7fca880be3a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c4b0 tx=0x7fca7c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c005480 con 0x7fca880b8690 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0035f0 con 0x7fca880b8690 2023-12-19T13:33:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca880bfbc0 con 0x7fca880b8690 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0039a0 con 0x7fca880b8690 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.846+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca881d56a0 con 0x7fca880b8690 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.847+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca881d5860 con 0x7fca880b8690 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.848+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca7c003b00 con 0x7fca880b8690 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.848+0000 7fca84ff9640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fca7406a430 0x7fca7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.849+0000 7fca87fff640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fca7406a430 0x7fca7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.849+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca7c087c30 con 0x7fca880b8690 2023-12-19T13:33:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.849+0000 7fca87fff640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fca7406a430 0x7fca7406c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fca78036000 tx=0x7fca78008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:45.853+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca7c0534f0 con 0x7fca880b8690 2023-12-19T13:33:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.030+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fca88073a40 con 0x7fca880b8690 2023-12-19T13:33:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.964+0000 7fca84ff9640 1 -- 172.21.15.6:0/3831266627 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fca7c0170b0 con 0x7fca880b8690 2023-12-19T13:33:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-12-19T13:33:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fca7406a430 msgr2=0x7fca7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fca7406a430 0x7fca7406c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fca78036000 tx=0x7fca78008030 comp rx=0 tx=0).stop 2023-12-19T13:33:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 msgr2=0x7fca880be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 0x7fca880be3a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c4b0 tx=0x7fca7c00c970 comp rx=0 tx=0).stop 2023-12-19T13:33:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 shutdown_connections 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fca7406a430 0x7fca7406c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca88144d80 0x7fca881e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca880b8690 0x7fca880be3a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 --2- 172.21.15.6:0/3831266627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca880b77d0 0x7fca8813ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 >> 172.21.15.6:0/3831266627 conn(0x7fca8806b6a0 msgr2=0x7fca880b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 shutdown_connections 2023-12-19T13:33:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:46.970+0000 7fca8e527640 1 -- 172.21.15.6:0/3831266627 wait complete. 2023-12-19T13:33:46.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T13:33:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.102+0000 7f706207d640 1 Processor -- start 2023-12-19T13:33:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.102+0000 7f706207d640 1 -- start start 2023-12-19T13:33:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f706207d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f706207d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f705c0b77d0 0x7f705c144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f706207d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c14ab10 con 0x7f705c144bb0 2023-12-19T13:33:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f706207d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c06c2f0 con 0x7f705c0b77d0 2023-12-19T13:33:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f706207d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0ba620 con 0x7f705c0b8690 2023-12-19T13:33:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f705bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f705c144bb0 0x7f705c14afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40930/0 (socket says 172.21.15.6:40930) 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f705bfff640 1 -- 172.21.15.6:0/295932692 learned_addr learned my addr 172.21.15.6:0/295932692 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f705affd640 1 --2- 172.21.15.6:0/295932692 >> v2:172.21.15.89:3300/0 conn(0x7f705c0b77d0 0x7f705c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f705b7fe640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f705a7fc640 1 -- 172.21.15.6:0/295932692 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650054557 0 0) 0x7f705c14ab10 con 0x7f705c144bb0 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.103+0000 7f705a7fc640 1 -- 172.21.15.6:0/295932692 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7044003520 con 0x7f705c144bb0 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705affd640 1 -- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 msgr2=0x7f705c0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705affd640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705affd640 1 -- 172.21.15.6:0/295932692 >> v1:172.21.15.6:6789/0 conn(0x7f705c144bb0 legacy=0x7f705c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705a7fc640 1 -- 172.21.15.6:0/295932692 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1775619491 0 0) 0x7f7044003520 con 0x7f705c144bb0 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705affd640 1 -- 172.21.15.6:0/295932692 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0b9e60 con 0x7f705c0b77d0 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705b7fe640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.104+0000 7f705affd640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c144670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70500097a0 tx=0x7f705002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89aa25e25c9433ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f705a7fc640 1 -- 172.21.15.6:0/295932692 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540019f0 con 0x7f705c0b77d0 2023-12-19T13:33:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f705a7fc640 1 -- 172.21.15.6:0/295932692 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705002e050 con 0x7f705c0b77d0 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f705a7fc640 1 -- 172.21.15.6:0/295932692 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050030710 con 0x7f705c0b77d0 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 -- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 msgr2=0x7f705c144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c144670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70500097a0 tx=0x7f705002b710 comp rx=0 tx=0).stop 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 -- 172.21.15.6:0/295932692 shutdown_connections 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c144670 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 --2- 172.21.15.6:0/295932692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 -- 172.21.15.6:0/295932692 >> 172.21.15.6:0/295932692 conn(0x7f705c06b6a0 msgr2=0x7f705c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 -- 172.21.15.6:0/295932692 shutdown_connections 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.105+0000 7f706207d640 1 -- 172.21.15.6:0/295932692 wait complete. 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.106+0000 7f706207d640 1 Processor -- start 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 -- start start 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c13d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c1d7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 0x7f705c13b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c1d79c0 con 0x7f705c144bb0 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c13c450 con 0x7f705c0b77d0 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f706207d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c13c730 con 0x7f705c0b8690 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f705bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 0x7f705c13b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f705bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 0x7f705c13b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53316/0 (socket says 172.21.15.6:53316) 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f705bfff640 1 -- 172.21.15.6:0/1187712215 learned_addr learned my addr 172.21.15.6:0/1187712215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f705affd640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c1d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.107+0000 7f705b7fe640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c13d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f705bfff640 1 -- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 msgr2=0x7f705c1d7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f705bfff640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c1d7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f705bfff640 1 -- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 msgr2=0x7f705c13d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f705bfff640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c13d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f705bfff640 1 -- 172.21.15.6:0/1187712215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009400 con 0x7f705c144bb0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f705bfff640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 0x7f705c13b790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f705400cc00 tx=0x7f705400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400ce10 con 0x7f705c144bb0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054012400 con 0x7f705c144bb0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7050009400 con 0x7f705c144bb0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540127b0 con 0x7f705c144bb0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.108+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c13ccf0 con 0x7f705c144bb0 2023-12-19T13:33:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.109+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c073a40 con 0x7f705c144bb0 2023-12-19T13:33:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.109+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7054012910 con 0x7f705c144bb0 2023-12-19T13:33:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.110+0000 7f7043fff640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f704806a430 0x7f704806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.110+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7054088dd0 con 0x7f705c144bb0 2023-12-19T13:33:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.110+0000 7f705b7fe640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f704806a430 0x7f704806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.110+0000 7f705b7fe640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f704806a430 0x7f704806c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f704c009c60 tx=0x7f704c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.114+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7054054630 con 0x7f705c144bb0 2023-12-19T13:33:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.291+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f705c13ceb0 con 0x7f705c144bb0 2023-12-19T13:33:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.972+0000 7f7043fff640 1 -- 172.21.15.6:0/1187712215 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f705408a0d0 con 0x7f705c144bb0 2023-12-19T13:33:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-12-19T13:33:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.978+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f704806a430 msgr2=0x7f704806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.978+0000 7f706207d640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f704806a430 0x7f704806c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f704c009c60 tx=0x7f704c008040 comp rx=0 tx=0).stop 2023-12-19T13:33:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.978+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 msgr2=0x7f705c13b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.978+0000 7f706207d640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 0x7f705c13b790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f705400cc00 tx=0x7f705400a430 comp rx=0 tx=0).stop 2023-12-19T13:33:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.979+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 shutdown_connections 2023-12-19T13:33:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.979+0000 7f706207d640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f704806a430 0x7f704806c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.979+0000 7f706207d640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f705c144bb0 0x7f705c13b790 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.979+0000 7f706207d640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f705c0b8690 0x7f705c1d7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.979+0000 7f706207d640 1 --2- 172.21.15.6:0/1187712215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f705c0b77d0 0x7f705c13d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.979+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 >> 172.21.15.6:0/1187712215 conn(0x7f705c06b6a0 msgr2=0x7f705c0ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:47.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.983+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 shutdown_connections 2023-12-19T13:33:47.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:47.983+0000 7f706207d640 1 -- 172.21.15.6:0/1187712215 wait complete. 2023-12-19T13:33:48.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T13:33:48.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.114+0000 7fbfd9dfd640 1 Processor -- start 2023-12-19T13:33:48.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.114+0000 7fbfd9dfd640 1 -- start start 2023-12-19T13:33:48.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd9dfd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfd40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd9dfd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd414ab10 con 0x7fbfd40b8690 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd9dfd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd406c2f0 con 0x7fbfd40b77d0 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd9dfd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40ba620 con 0x7fbfd4144d80 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbfd40b8690 0x7fbfd4144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40938/0 (socket says 172.21.15.6:40938) 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd37fe640 1 -- 172.21.15.6:0/3126227100 learned_addr learned my addr 172.21.15.6:0/3126227100 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfd40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575727634 0 0) 0x7fbfd414ab10 con 0x7fbfd40b8690 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.115+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfbc003520 con 0x7fbfd40b8690 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048639443 0 0) 0x7fbfd406c2f0 con 0x7fbfd40b77d0 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd414ab10 con 0x7fbfd40b77d0 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1217687712 0 0) 0x7fbfbc003520 con 0x7fbfd40b8690 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 msgr2=0x7fbfd40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfd40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 >> v1:172.21.15.89:6789/0 conn(0x7fbfd40b77d0 legacy=0x7fbfd414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40b9e60 con 0x7fbfd40b8690 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fbfc4001670 con 0x7fbfd40b8690 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 >> v1:172.21.15.6:6789/0 conn(0x7fbfd40b8690 legacy=0x7fbfd4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc003b30 0x7fbfbc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfbc0047c0 0x7fbfbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfbc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40ba620 con 0x7fbfbc0047c0 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc00ba90 con 0x7fbfbc003b30 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc00bc50 con 0x7fbfd4144d80 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfbc0047c0 0x7fbfbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd37fe640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc003b30 0x7fbfbc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd3fff640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfbc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 msgr2=0x7fbfbc0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfbc0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc003b30 msgr2=0x7fbfbc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc003b30 0x7fbfbc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/3126227100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc003520 con 0x7fbfbc0047c0 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.116+0000 7fbfd3fff640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4144d80 0x7fbfbc0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfbc0047c0 0x7fbfbc004c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009ac0 tx=0x7fbfbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f526e0ffc26c4e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc802c6b0 con 0x7fbfbc0047c0 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc802c810 con 0x7fbfbc0047c0 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd27fc640 1 -- 172.21.15.6:0/3126227100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc802cba0 con 0x7fbfbc0047c0 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/3126227100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfbc0047c0 msgr2=0x7fbfbc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/3126227100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfbc0047c0 0x7fbfbc004c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009ac0 tx=0x7fbfbc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.117+0000 7fbfd3fff640 1 -- 172.21.15.6:0/3126227100 reap_dead start 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.118+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/3126227100 shutdown_connections 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.118+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/3126227100 >> 172.21.15.6:0/3126227100 conn(0x7fbfd406b6a0 msgr2=0x7fbfd406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.118+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/3126227100 shutdown_connections 2023-12-19T13:33:48.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.118+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/3126227100 wait complete. 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 Processor -- start 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 -- start start 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc0047c0 0x7fbfd413f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 0x7fbfd4148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4141190 0x7fbfd41493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41498e0 con 0x7fbfd4140d30 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4149f70 con 0x7fbfbc0047c0 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd9dfd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4149cd0 con 0x7fbfd4141190 2023-12-19T13:33:48.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.119+0000 7fbfd2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 0x7fbfd4148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 0x7fbfd4148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53328/0 (socket says 172.21.15.6:53328) 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/1372529209 learned_addr learned my addr 172.21.15.6:0/1372529209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd37fe640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc0047c0 0x7fbfd413f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd3fff640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4141190 0x7fbfd41493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4141190 msgr2=0x7fbfd41493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4141190 0x7fbfd41493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc0047c0 msgr2=0x7fbfd413f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc0047c0 0x7fbfd413f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 -- 172.21.15.6:0/1372529209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd41e0110 con 0x7fbfd4140d30 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd2ffd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 0x7fbfd4148e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbfc802c250 tx=0x7fbfc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003810 con 0x7fbfd4140d30 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8003970 con 0x7fbfd4140d30 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd41e03b0 con 0x7fbfd4140d30 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003ce0 con 0x7fbfd4140d30 2023-12-19T13:33:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.120+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd41e08d0 con 0x7fbfd4140d30 2023-12-19T13:33:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.121+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd41dff40 con 0x7fbfd4140d30 2023-12-19T13:33:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.122+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfc8034440 con 0x7fbfd4140d30 2023-12-19T13:33:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.122+0000 7fbfbbfff640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfc006a430 0x7fbfc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.122+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbfc80aaae0 con 0x7fbfd4140d30 2023-12-19T13:33:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.122+0000 7fbfd37fe640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfc006a430 0x7fbfc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.123+0000 7fbfd37fe640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfc006a430 0x7fbfc006c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4001eb0 tx=0x7fbfc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.127+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfc8076150 con 0x7fbfd4140d30 2023-12-19T13:33:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.341+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbfd40664a0 con 0x7fbfd4140d30 2023-12-19T13:33:48.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.347+0000 7fbfbbfff640 1 -- 172.21.15.6:0/1372529209 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbfc8039020 con 0x7fbfd4140d30 2023-12-19T13:33:48.349 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T13:33:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.352+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfc006a430 msgr2=0x7fbfc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.352+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfc006a430 0x7fbfc006c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4001eb0 tx=0x7fbfc4009040 comp rx=0 tx=0).stop 2023-12-19T13:33:48.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.352+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 msgr2=0x7fbfd4148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.352+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 0x7fbfd4148e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbfc802c250 tx=0x7fbfc8004730 comp rx=0 tx=0).stop 2023-12-19T13:33:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.357+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 shutdown_connections 2023-12-19T13:33:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.357+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfc006a430 0x7fbfc006c8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.357+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd4141190 0x7fbfd41493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.357+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfd4140d30 0x7fbfd4148e60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.357+0000 7fbfd9dfd640 1 --2- 172.21.15.6:0/1372529209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc0047c0 0x7fbfd413f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.357+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 >> 172.21.15.6:0/1372529209 conn(0x7fbfd406b6a0 msgr2=0x7fbfd40baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.361+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 shutdown_connections 2023-12-19T13:33:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.361+0000 7fbfd9dfd640 1 -- 172.21.15.6:0/1372529209 wait complete. 2023-12-19T13:33:48.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.485+0000 7f5eb4aa1640 1 Processor -- start 2023-12-19T13:33:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.485+0000 7f5eb4aa1640 1 -- start start 2023-12-19T13:33:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eb4aa1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb00ba290 0x7f5eb006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eb4aa1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5eb006d770 0x7f5eb014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eb4aa1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb006b820 con 0x7f5eb006f420 2023-12-19T13:33:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eb4aa1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb006de60 con 0x7f5eb006d770 2023-12-19T13:33:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eb4aa1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb006eac0 con 0x7f5eb00ba290 2023-12-19T13:33:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eadd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5eb006d770 0x7f5eb014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eadd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5eb006d770 0x7f5eb014aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53344/0 (socket says 172.21.15.6:53344) 2023-12-19T13:33:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eadd9b640 1 -- 172.21.15.6:0/2041028319 learned_addr learned my addr 172.21.15.6:0/2041028319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.486+0000 7f5eae59c640 1 --2- 172.21.15.6:0/2041028319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb00ba290 0x7f5eb006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.487+0000 7f5eadd9b640 1 -- 172.21.15.6:0/2041028319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb00ba290 msgr2=0x7f5eb006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.487+0000 7f5eadd9b640 1 --2- 172.21.15.6:0/2041028319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb00ba290 0x7f5eb006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.487+0000 7f5eadd9b640 1 -- 172.21.15.6:0/2041028319 >> v1:172.21.15.89:6789/0 conn(0x7f5eb006f420 legacy=0x7f5eb014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.487+0000 7f5eadd9b640 1 -- 172.21.15.6:0/2041028319 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb006aef0 con 0x7f5eb006d770 2023-12-19T13:33:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.487+0000 7f5eadd9b640 1 --2- 172.21.15.6:0/2041028319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb006d770 0x7f5eb014aae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009870 tx=0x7f5e9802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a42f4f25ab54f60 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.487+0000 7f5ead59a640 1 -- 172.21.15.6:0/2041028319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9802f840 con 0x7f5eb006d770 2023-12-19T13:33:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5ead59a640 1 -- 172.21.15.6:0/2041028319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9802f9a0 con 0x7f5eb006d770 2023-12-19T13:33:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5ead59a640 1 -- 172.21.15.6:0/2041028319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9802fd30 con 0x7f5eb006d770 2023-12-19T13:33:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2041028319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb006d770 msgr2=0x7f5eb014aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2041028319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb006d770 0x7f5eb014aae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009870 tx=0x7f5e9802ba20 comp rx=0 tx=0).stop 2023-12-19T13:33:48.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2041028319 shutdown_connections 2023-12-19T13:33:48.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2041028319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb006d770 0x7f5eb014aae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2041028319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb00ba290 0x7f5eb006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2041028319 >> 172.21.15.6:0/2041028319 conn(0x7f5eb00bac30 msgr2=0x7f5eb00bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:48.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2041028319 shutdown_connections 2023-12-19T13:33:48.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.488+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2041028319 wait complete. 2023-12-19T13:33:48.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.489+0000 7f5eb4aa1640 1 Processor -- start 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.489+0000 7f5eb4aa1640 1 -- start start 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eb4aa1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb006d770 0x7f5eb01453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eb4aa1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb006f420 0x7f5eb014b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eb4aa1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 0x7f5eb0147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eb4aa1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb014b720 con 0x7f5eb00ba290 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eb4aa1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01e0380 con 0x7f5eb006f420 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eb4aa1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0145f90 con 0x7f5eb006d770 2023-12-19T13:33:48.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 0x7f5eb0147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 0x7f5eb0147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53350/0 (socket says 172.21.15.6:53350) 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 -- 172.21.15.6:0/2835464591 learned_addr learned my addr 172.21.15.6:0/2835464591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eae59c640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb006d770 0x7f5eb01453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eadd9b640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb006f420 0x7f5eb014b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 -- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb006d770 msgr2=0x7f5eb01453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb006d770 0x7f5eb01453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 -- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb006f420 msgr2=0x7f5eb014b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb006f420 0x7f5eb014b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.490+0000 7f5eaed9d640 1 -- 172.21.15.6:0/2835464591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980094d0 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.491+0000 7f5eaed9d640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 0x7f5eb0147bc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c7a0 tx=0x7f5ea000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.491+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0003b70 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.491+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea0003cf0 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.491+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb01459d0 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.491+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000aa90 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.491+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb01476a0 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.492+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb006e5b0 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.492+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ea000abf0 con 0x7f5eb00ba290 2023-12-19T13:33:48.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.493+0000 7f5ea6ffd640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e9006a430 0x7f5e9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.493+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ea0088600 con 0x7f5eb00ba290 2023-12-19T13:33:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.493+0000 7f5eae59c640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e9006a430 0x7f5e9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.493+0000 7f5eae59c640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e9006a430 0x7f5e9006c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009b40 tx=0x7f5ea8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.497+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ea0053ca0 con 0x7f5eb00ba290 2023-12-19T13:33:48.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.675+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eb0073a40 con 0x7f5eb00ba290 2023-12-19T13:33:48.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.676+0000 7f5ea6ffd640 1 -- 172.21.15.6:0/2835464591 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16018 (secure 0 0 0) 0x7f5ea0003e60 con 0x7f5eb00ba290 2023-12-19T13:33:48.678 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:48.678 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:48.342969+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e9006a430 msgr2=0x7f5e9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e9006a430 0x7f5e9006c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009b40 tx=0x7f5ea8009190 comp rx=0 tx=0).stop 2023-12-19T13:33:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 msgr2=0x7f5eb0147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 0x7f5eb0147bc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c7a0 tx=0x7f5ea000cc60 comp rx=0 tx=0).stop 2023-12-19T13:33:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 shutdown_connections 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e9006a430 0x7f5e9006c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb00ba290 0x7f5eb0147bc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb006f420 0x7f5eb014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 --2- 172.21.15.6:0/2835464591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5eb006d770 0x7f5eb01453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 >> 172.21.15.6:0/2835464591 conn(0x7f5eb00bac30 msgr2=0x7f5eb00a1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 shutdown_connections 2023-12-19T13:33:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.678+0000 7f5eb4aa1640 1 -- 172.21.15.6:0/2835464591 wait complete. 2023-12-19T13:33:48.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.794+0000 7fb60e3d0640 1 Processor -- start 2023-12-19T13:33:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.794+0000 7fb60e3d0640 1 -- start start 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60e3d0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb60806a6d0 0x7fb60814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60e3d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb60814b1f0 0x7fb6080b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60e3d0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080bb310 con 0x7fb6080ba550 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60e3d0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080bf960 con 0x7fb60814b1f0 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60e3d0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080bb5b0 con 0x7fb60806a6d0 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb6077fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb60814b1f0 0x7fb6080b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60c96d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6080ba550 0x7fb60814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40954/0 (socket says 172.21.15.6:40954) 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb60c96d640 1 -- 172.21.15.6:0/2895781938 learned_addr learned my addr 172.21.15.6:0/2895781938 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb607fff640 1 --2- 172.21.15.6:0/2895781938 >> v2:172.21.15.89:3300/0 conn(0x7fb60806a6d0 0x7fb60814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb6077fe640 1 -- 172.21.15.6:0/2895781938 >> v2:172.21.15.89:3300/0 conn(0x7fb60806a6d0 msgr2=0x7fb60814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb6077fe640 1 --2- 172.21.15.6:0/2895781938 >> v2:172.21.15.89:3300/0 conn(0x7fb60806a6d0 0x7fb60814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb6077fe640 1 -- 172.21.15.6:0/2895781938 >> v1:172.21.15.6:6789/0 conn(0x7fb6080ba550 legacy=0x7fb60814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.795+0000 7fb6077fe640 1 -- 172.21.15.6:0/2895781938 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080c0120 con 0x7fb60814b1f0 2023-12-19T13:33:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.796+0000 7fb6077fe640 1 --2- 172.21.15.6:0/2895781938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60814b1f0 0x7fb6080b9ac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb60808a260 tx=0x7fb5f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fce8c43a37c1c68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.796+0000 7fb606ffd640 1 -- 172.21.15.6:0/2895781938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8031830 con 0x7fb60814b1f0 2023-12-19T13:33:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.796+0000 7fb606ffd640 1 -- 172.21.15.6:0/2895781938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f8031990 con 0x7fb60814b1f0 2023-12-19T13:33:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.796+0000 7fb606ffd640 1 -- 172.21.15.6:0/2895781938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8031d20 con 0x7fb60814b1f0 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.796+0000 7fb60e3d0640 1 -- 172.21.15.6:0/2895781938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60814b1f0 msgr2=0x7fb6080b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.796+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/2895781938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60814b1f0 0x7fb6080b9ac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb60808a260 tx=0x7fb5f802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.797+0000 7fb60e3d0640 1 -- 172.21.15.6:0/2895781938 shutdown_connections 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.797+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/2895781938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60814b1f0 0x7fb6080b9ac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.797+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/2895781938 >> v2:172.21.15.89:3300/0 conn(0x7fb60806a6d0 0x7fb60814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.797+0000 7fb60e3d0640 1 -- 172.21.15.6:0/2895781938 >> 172.21.15.6:0/2895781938 conn(0x7fb6080c0350 msgr2=0x7fb6080c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.797+0000 7fb60e3d0640 1 -- 172.21.15.6:0/2895781938 shutdown_connections 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.797+0000 7fb60e3d0640 1 -- 172.21.15.6:0/2895781938 wait complete. 2023-12-19T13:33:48.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 Processor -- start 2023-12-19T13:33:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 -- start start 2023-12-19T13:33:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 0x7fb6080a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6080ba550 0x7fb60814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb60814b1f0 0x7fb608143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080a5c20 con 0x7fb60806a6d0 2023-12-19T13:33:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608147690 con 0x7fb6080ba550 2023-12-19T13:33:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.798+0000 7fb60e3d0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60814d100 con 0x7fb60814b1f0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 0x7fb6080a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 0x7fb6080a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53370/0 (socket says 172.21.15.6:53370) 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 -- 172.21.15.6:0/3726777054 learned_addr learned my addr 172.21.15.6:0/3726777054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 -- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb60814b1f0 msgr2=0x7fb608143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb60c96d640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb60814b1f0 0x7fb608143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb6077fe640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6080ba550 0x7fb60814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb60814b1f0 0x7fb608143fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 -- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6080ba550 msgr2=0x7fb60814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6080ba550 0x7fb60814cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 -- 172.21.15.6:0/3726777054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8009400 con 0x7fb60806a6d0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb607fff640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 0x7fb6080a56e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d830 tx=0x7fb5fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00b6c0 con 0x7fb60806a6d0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00b820 con 0x7fb60806a6d0 2023-12-19T13:33:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00bbb0 con 0x7fb60806a6d0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60814dba0 con 0x7fb60806a6d0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.799+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60814d5e0 con 0x7fb60806a6d0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.800+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb608073a40 con 0x7fb60806a6d0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.801+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5fc01e460 con 0x7fb60806a6d0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.801+0000 7fb604ff9640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb5f406a430 0x7fb5f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.801+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5fc089000 con 0x7fb60806a6d0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.801+0000 7fb6077fe640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb5f406a430 0x7fb5f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.802+0000 7fb6077fe640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb5f406a430 0x7fb5f406c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8036000 tx=0x7fb5f803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:48.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.805+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5fc054680 con 0x7fb60806a6d0 2023-12-19T13:33:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.983+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6080a62d0 con 0x7fb60806a6d0 2023-12-19T13:33:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.984+0000 7fb604ff9640 1 -- 172.21.15.6:0/3726777054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16018 (secure 0 0 0) 0x7fb5fc057ca0 con 0x7fb60806a6d0 2023-12-19T13:33:48.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:48.986 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:48.342969+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb5f406a430 msgr2=0x7fb5f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb5f406a430 0x7fb5f406c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8036000 tx=0x7fb5f803c040 comp rx=0 tx=0).stop 2023-12-19T13:33:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 msgr2=0x7fb6080a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 0x7fb6080a56e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d830 tx=0x7fb5fc00dcf0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 shutdown_connections 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb5f406a430 0x7fb5f406c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb60814b1f0 0x7fb608143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6080ba550 0x7fb60814cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 --2- 172.21.15.6:0/3726777054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb60806a6d0 0x7fb6080a56e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 >> 172.21.15.6:0/3726777054 conn(0x7fb6080c0350 msgr2=0x7fb6080be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 shutdown_connections 2023-12-19T13:33:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:48.986+0000 7fb60e3d0640 1 -- 172.21.15.6:0/3726777054 wait complete. 2023-12-19T13:33:48.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T13:33:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.105+0000 7f5ac0e8f640 1 Processor -- start 2023-12-19T13:33:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.105+0000 7f5ac0e8f640 1 -- start start 2023-12-19T13:33:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5ac0e8f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5abc069d00 0x7f5abc0a2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5ac0e8f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc0b9950 con 0x7f5abc070130 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5ac0e8f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc070a40 con 0x7f5abc071b30 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5ac0e8f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc0b9760 con 0x7f5abc069d00 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5aba59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5abc070130 0x7f5abc149300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40962/0 (socket says 172.21.15.6:40962) 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5ab9d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5abc069d00 0x7f5abc0a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.106+0000 7f5aba59c640 1 -- 172.21.15.6:0/3205336223 learned_addr learned my addr 172.21.15.6:0/3205336223 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.107+0000 7f5ab9d9b640 1 -- 172.21.15.6:0/3205336223 >> v1:172.21.15.89:6789/0 conn(0x7f5abc071b30 legacy=0x7f5abc1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.107+0000 7f5ab9d9b640 1 -- 172.21.15.6:0/3205336223 >> v1:172.21.15.6:6789/0 conn(0x7f5abc070130 legacy=0x7f5abc149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.107+0000 7f5ab9d9b640 1 -- 172.21.15.6:0/3205336223 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc0b9480 con 0x7f5abc069d00 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.107+0000 7f5ab9d9b640 1 --2- 172.21.15.6:0/3205336223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0a2790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00097a0 tx=0x7f5ab002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6635818eecefa17 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.107+0000 7f5ab959a640 1 -- 172.21.15.6:0/3205336223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0030610 con 0x7f5abc069d00 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ab959a640 1 -- 172.21.15.6:0/3205336223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab0030770 con 0x7f5abc069d00 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ab959a640 1 -- 172.21.15.6:0/3205336223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0030b00 con 0x7f5abc069d00 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/3205336223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 msgr2=0x7f5abc0a2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/3205336223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0a2790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00097a0 tx=0x7f5ab002b960 comp rx=0 tx=0).stop 2023-12-19T13:33:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/3205336223 shutdown_connections 2023-12-19T13:33:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/3205336223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0a2790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/3205336223 >> 172.21.15.6:0/3205336223 conn(0x7f5abc06ae10 msgr2=0x7f5abc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/3205336223 shutdown_connections 2023-12-19T13:33:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.108+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/3205336223 wait complete. 2023-12-19T13:33:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.109+0000 7f5ac0e8f640 1 Processor -- start 2023-12-19T13:33:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.109+0000 7f5ac0e8f640 1 -- start start 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ac0e8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ac0e8f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5abc070130 0x7f5abc1e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ac0e8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5abc071b30 0x7f5abc14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ac0e8f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0b5c90 con 0x7f5abc069d00 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ac0e8f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1d3610 con 0x7f5abc071b30 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ac0e8f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1e13b0 con 0x7f5abc070130 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53388/0 (socket says 172.21.15.6:53388) 2023-12-19T13:33:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 -- 172.21.15.6:0/502701482 learned_addr learned my addr 172.21.15.6:0/502701482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ab9d9b640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5abc070130 0x7f5abc1e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5abad9d640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5abc071b30 0x7f5abc14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 -- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5abc070130 msgr2=0x7f5abc1e0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5abc070130 0x7f5abc1e0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 -- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5abc071b30 msgr2=0x7f5abc14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5abc071b30 0x7f5abc14bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5aba59c640 1 -- 172.21.15.6:0/502701482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009400 con 0x7f5abc069d00 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5ab9d9b640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5abc070130 0x7f5abc1e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.110+0000 7f5abad9d640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5abc071b30 0x7f5abc14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.111+0000 7f5aba59c640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0b5750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00c430 tx=0x7f5aac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.111+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac005ce0 con 0x7f5abc069d00 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.111+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac005e40 con 0x7f5abc069d00 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.111+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc1d42e0 con 0x7f5abc069d00 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.111+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0072f0 con 0x7f5abc069d00 2023-12-19T13:33:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.111+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc1dddb0 con 0x7f5abc069d00 2023-12-19T13:33:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.112+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc073a40 con 0x7f5abc069d00 2023-12-19T13:33:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.112+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5aac007510 con 0x7f5abc069d00 2023-12-19T13:33:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.113+0000 7f5aaaffd640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9c06a430 0x7f5a9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.113+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5aac087eb0 con 0x7f5abc069d00 2023-12-19T13:33:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.113+0000 7f5ab9d9b640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9c06a430 0x7f5a9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.113+0000 7f5ab9d9b640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9c06a430 0x7f5a9c06c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0036000 tx=0x7f5ab0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.117+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5aac053530 con 0x7f5abc069d00 2023-12-19T13:33:49.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.334+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5abc071430 con 0x7f5abc069d00 2023-12-19T13:33:49.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.971+0000 7f5aaaffd640 1 -- 172.21.15.6:0/502701482 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5aac0170b0 con 0x7f5abc069d00 2023-12-19T13:33:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9c06a430 msgr2=0x7f5a9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9c06a430 0x7f5a9c06c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0036000 tx=0x7f5ab0008030 comp rx=0 tx=0).stop 2023-12-19T13:33:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 msgr2=0x7f5abc0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:49.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0b5750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00c430 tx=0x7f5aac00c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 shutdown_connections 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a9c06a430 0x7f5a9c06c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5abc071b30 0x7f5abc14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5abc070130 0x7f5abc1e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 --2- 172.21.15.6:0/502701482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5abc069d00 0x7f5abc0b5750 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 >> 172.21.15.6:0/502701482 conn(0x7f5abc06ae10 msgr2=0x7f5abc0b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 shutdown_connections 2023-12-19T13:33:49.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:49.974+0000 7f5ac0e8f640 1 -- 172.21.15.6:0/502701482 wait complete. 2023-12-19T13:33:49.989 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T13:33:49.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T13:33:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.101+0000 7fcf73b39640 1 Processor -- start 2023-12-19T13:33:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.101+0000 7fcf73b39640 1 -- start start 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf73b39640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf6c142f20 0x7fcf6c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf73b39640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf6c0a0cc0 0x7fcf6c0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf73b39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c0b47d0 0x7fcf6c0b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf73b39640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c0b37e0 con 0x7fcf6c142f20 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf73b39640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c1498f0 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf73b39640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c148fc0 con 0x7fcf6c0b47d0 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf6c142f20 0x7fcf6c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf6c142f20 0x7fcf6c0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53392/0 (socket says 172.21.15.6:53392) 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 -- 172.21.15.6:0/88731267 learned_addr learned my addr 172.21.15.6:0/88731267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf720d6640 1 --2- 172.21.15.6:0/88731267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c0b47d0 0x7fcf6c0b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf710d4640 1 --2- 172.21.15.6:0/88731267 >> v2:172.21.15.89:3300/0 conn(0x7fcf6c0a0cc0 0x7fcf6c0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 -- 172.21.15.6:0/88731267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c0b47d0 msgr2=0x7fcf6c0b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 --2- 172.21.15.6:0/88731267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c0b47d0 0x7fcf6c0b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 -- 172.21.15.6:0/88731267 >> v2:172.21.15.89:3300/0 conn(0x7fcf6c0a0cc0 msgr2=0x7fcf6c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 --2- 172.21.15.6:0/88731267 >> v2:172.21.15.89:3300/0 conn(0x7fcf6c0a0cc0 0x7fcf6c0b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.102+0000 7fcf718d5640 1 -- 172.21.15.6:0/88731267 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c1492a0 con 0x7fcf6c142f20 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.103+0000 7fcf718d5640 1 --2- 172.21.15.6:0/88731267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c142f20 0x7fcf6c0b4290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c066640 tx=0x7fcf6802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a356c71c9efb96e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.103+0000 7fcf708d3640 1 -- 172.21.15.6:0/88731267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68030860 con 0x7fcf6c142f20 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.103+0000 7fcf708d3640 1 -- 172.21.15.6:0/88731267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf680309c0 con 0x7fcf6c142f20 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.103+0000 7fcf708d3640 1 -- 172.21.15.6:0/88731267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68030d50 con 0x7fcf6c142f20 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 -- 172.21.15.6:0/88731267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c142f20 msgr2=0x7fcf6c0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 --2- 172.21.15.6:0/88731267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c142f20 0x7fcf6c0b4290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c066640 tx=0x7fcf6802b9a0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 -- 172.21.15.6:0/88731267 shutdown_connections 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 --2- 172.21.15.6:0/88731267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c0b47d0 0x7fcf6c0b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 --2- 172.21.15.6:0/88731267 >> v2:172.21.15.89:3300/0 conn(0x7fcf6c0a0cc0 0x7fcf6c0b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 --2- 172.21.15.6:0/88731267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c142f20 0x7fcf6c0b4290 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 -- 172.21.15.6:0/88731267 >> 172.21.15.6:0/88731267 conn(0x7fcf6c0be1e0 msgr2=0x7fcf6c0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:50.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 -- 172.21.15.6:0/88731267 shutdown_connections 2023-12-19T13:33:50.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.104+0000 7fcf73b39640 1 -- 172.21.15.6:0/88731267 wait complete. 2023-12-19T13:33:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 Processor -- start 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 -- start start 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 0x7fcf6c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf6c0b47d0 0x7fcf6c0a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c142f20 0x7fcf6c1de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0a33d0 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c1de8e0 con 0x7fcf6c0b47d0 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf73b39640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0a16b0 con 0x7fcf6c142f20 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf718d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 0x7fcf6c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf718d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 0x7fcf6c06f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53394/0 (socket says 172.21.15.6:53394) 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.105+0000 7fcf718d5640 1 -- 172.21.15.6:0/3843696427 learned_addr learned my addr 172.21.15.6:0/3843696427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf720d6640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c142f20 0x7fcf6c1de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf710d4640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf6c0b47d0 0x7fcf6c0a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf718d5640 1 -- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c142f20 msgr2=0x7fcf6c1de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf718d5640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c142f20 0x7fcf6c1de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf718d5640 1 -- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf6c0b47d0 msgr2=0x7fcf6c0a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf718d5640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf6c0b47d0 0x7fcf6c0a2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf718d5640 1 -- 172.21.15.6:0/3843696427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680094d0 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf720d6640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c142f20 0x7fcf6c1de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf718d5640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 0x7fcf6c06f570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf6802b9e0 tx=0x7fcf68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68039a90 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68039bf0 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c0a2700 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68043410 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.106+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c06dd70 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.107+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c066e90 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.108+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf6804c3b0 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.108+0000 7fcf627fc640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcf5006a430 0x7fcf5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.108+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf680aaf00 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.108+0000 7fcf710d4640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcf5006a430 0x7fcf5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.109+0000 7fcf710d4640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcf5006a430 0x7fcf5006c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c14cfc0 tx=0x7fcf5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.112+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcf68076580 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.327+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcf6c06f290 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.973+0000 7fcf627fc640 1 -- 172.21.15.6:0/3843696427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf680340c0 con 0x7fcf6c0a0cc0 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.975+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcf5006a430 msgr2=0x7fcf5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.975+0000 7fcf73b39640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcf5006a430 0x7fcf5006c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c14cfc0 tx=0x7fcf5c008040 comp rx=0 tx=0).stop 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.975+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 msgr2=0x7fcf6c06f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.975+0000 7fcf73b39640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 0x7fcf6c06f570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf6802b9e0 tx=0x7fcf68004730 comp rx=0 tx=0).stop 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 shutdown_connections 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fcf5006a430 0x7fcf5006c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf6c142f20 0x7fcf6c1de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf6c0b47d0 0x7fcf6c0a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 --2- 172.21.15.6:0/3843696427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6c0a0cc0 0x7fcf6c06f570 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 >> 172.21.15.6:0/3843696427 conn(0x7fcf6c0be1e0 msgr2=0x7fcf6c1404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 shutdown_connections 2023-12-19T13:33:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:50.976+0000 7fcf73b39640 1 -- 172.21.15.6:0/3843696427 wait complete. 2023-12-19T13:33:50.990 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T13:33:50.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.098+0000 7f0d9ff0a640 1 Processor -- start 2023-12-19T13:33:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.098+0000 7f0d9ff0a640 1 -- start start 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.098+0000 7f0d9ff0a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d9806a6d0 0x7f0d9814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.098+0000 7f0d9ff0a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d9814b1f0 0x7f0d980b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.098+0000 7f0d9ff0a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980bb310 con 0x7f0d980ba550 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.098+0000 7f0d9ff0a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980bf960 con 0x7f0d9814b1f0 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9ff0a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980bb5b0 con 0x7f0d9806a6d0 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9d4a5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d9814b1f0 0x7f0d980b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9e4a7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0d980ba550 0x7f0d9814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40968/0 (socket says 172.21.15.6:40968) 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9e4a7640 1 -- 172.21.15.6:0/934446429 learned_addr learned my addr 172.21.15.6:0/934446429 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9dca6640 1 --2- 172.21.15.6:0/934446429 >> v2:172.21.15.89:3300/0 conn(0x7f0d9806a6d0 0x7f0d9814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9d4a5640 1 -- 172.21.15.6:0/934446429 >> v2:172.21.15.89:3300/0 conn(0x7f0d9806a6d0 msgr2=0x7f0d9814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9d4a5640 1 --2- 172.21.15.6:0/934446429 >> v2:172.21.15.89:3300/0 conn(0x7f0d9806a6d0 0x7f0d9814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9d4a5640 1 -- 172.21.15.6:0/934446429 >> v1:172.21.15.6:6789/0 conn(0x7f0d980ba550 legacy=0x7f0d9814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9cca4640 1 -- 172.21.15.6:0/934446429 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867069606 0 0) 0x7f0d980bb310 con 0x7f0d980ba550 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9d4a5640 1 -- 172.21.15.6:0/934446429 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980c0120 con 0x7f0d9814b1f0 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.099+0000 7f0d9dca6640 1 --2- 172.21.15.6:0/934446429 >> v2:172.21.15.89:3300/0 conn(0x7f0d9806a6d0 0x7f0d9814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9d4a5640 1 --2- 172.21.15.6:0/934446429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9814b1f0 0x7f0d980b9ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0d9808a260 tx=0x7f0d8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a521158429957aba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9cca4640 1 -- 172.21.15.6:0/934446429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88031830 con 0x7f0d9814b1f0 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9cca4640 1 -- 172.21.15.6:0/934446429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88031990 con 0x7f0d9814b1f0 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9cca4640 1 -- 172.21.15.6:0/934446429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88031d20 con 0x7f0d9814b1f0 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/934446429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9814b1f0 msgr2=0x7f0d980b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/934446429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9814b1f0 0x7f0d980b9ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0d9808a260 tx=0x7f0d8802b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/934446429 shutdown_connections 2023-12-19T13:33:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/934446429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9814b1f0 0x7f0d980b9ac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/934446429 >> v2:172.21.15.89:3300/0 conn(0x7f0d9806a6d0 0x7f0d9814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.100+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/934446429 >> 172.21.15.6:0/934446429 conn(0x7f0d980c0350 msgr2=0x7f0d980c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.101+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/934446429 shutdown_connections 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.101+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/934446429 wait complete. 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 Processor -- start 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 -- start start 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 0x7f0d980a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d980ba550 0x7f0d980a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d9814b1f0 0x7f0d98143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980a1290 con 0x7f0d9806a6d0 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9814e6a0 con 0x7f0d9814b1f0 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9ff0a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980a5540 con 0x7f0d980ba550 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9dca6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 0x7f0d980a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9dca6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 0x7f0d980a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53404/0 (socket says 172.21.15.6:53404) 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.102+0000 7f0d9dca6640 1 -- 172.21.15.6:0/3847705033 learned_addr learned my addr 172.21.15.6:0/3847705033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9e4a7640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d9814b1f0 0x7f0d98143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9dca6640 1 -- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d980ba550 msgr2=0x7f0d980a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9d4a5640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d980ba550 0x7f0d980a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9dca6640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d980ba550 0x7f0d980a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9dca6640 1 -- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d9814b1f0 msgr2=0x7f0d98143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9dca6640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d9814b1f0 0x7f0d98143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9dca6640 1 -- 172.21.15.6:0/3847705033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009400 con 0x7f0d9806a6d0 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9e4a7640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d9814b1f0 0x7f0d98143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9dca6640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 0x7f0d980a0d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c7f0 tx=0x7f0d9400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94007a30 con 0x7f0d9806a6d0 2023-12-19T13:33:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94007b90 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400ce40 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9814eef0 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.103+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d980a5a70 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.104+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98073a40 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.104+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d940113f0 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.105+0000 7f0d8e7fc640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.105+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d94088b70 con 0x7f0d9806a6d0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.105+0000 7f0d9d4a5640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.106+0000 7f0d9d4a5640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0d88036000 tx=0x7f0d88008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.110+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d940540d0 con 0x7f0d9806a6d0 2023-12-19T13:33:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.323+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d980a15f0 con 0x7f0d9806a6d0 2023-12-19T13:33:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.324+0000 7f0d8e7fc640 1 -- 172.21.15.6:0/3847705033 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3882 (secure 0 0 0) 0x7f0d9401f020 con 0x7f0d9806a6d0 2023-12-19T13:33:51.328 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:51.328 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:48.343293+0000","modified":"2023-12-19T13:33:50.971099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/331533137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":331533137},{"type":"v1","addr":"172.21.15.6:6835","nonce":331533137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:33:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2023-12-19T13:33:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d7c06a430 msgr2=0x7f0d7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0d88036000 tx=0x7f0d88008030 comp rx=0 tx=0).stop 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 msgr2=0x7f0d980a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 0x7f0d980a0d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c7f0 tx=0x7f0d9400cbf0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 shutdown_connections 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f0d7c06a430 0x7f0d7c06c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d9814b1f0 0x7f0d98143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d980ba550 0x7f0d980a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 --2- 172.21.15.6:0/3847705033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d9806a6d0 0x7f0d980a0d50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 >> 172.21.15.6:0/3847705033 conn(0x7f0d980c0350 msgr2=0x7f0d98146c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 shutdown_connections 2023-12-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.326+0000 7f0d9ff0a640 1 -- 172.21.15.6:0/3847705033 wait complete. 2023-12-19T13:33:51.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T13:33:51.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.441+0000 7f331c3c4640 1 Processor -- start 2023-12-19T13:33:51.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.441+0000 7f331c3c4640 1 -- start start 2023-12-19T13:33:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331c3c4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f331406a6d0 0x7f331414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331c3c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33140ba550 0x7f33141554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331c3c4640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140bb310 con 0x7f331414b1f0 2023-12-19T13:33:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331c3c4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140bf960 con 0x7f331406a6d0 2023-12-19T13:33:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331c3c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140bb5b0 con 0x7f33140ba550 2023-12-19T13:33:51.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331a160640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f331406a6d0 0x7f331414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331995f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f331414b1f0 0x7f33140b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40970/0 (socket says 172.21.15.6:40970) 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.442+0000 7f331995f640 1 -- 172.21.15.6:0/1893060660 learned_addr learned my addr 172.21.15.6:0/1893060660 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a961640 1 --2- 172.21.15.6:0/1893060660 >> v2:172.21.15.89:3300/0 conn(0x7f33140ba550 0x7f33141554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a160640 1 -- 172.21.15.6:0/1893060660 >> v2:172.21.15.89:3300/0 conn(0x7f33140ba550 msgr2=0x7f33141554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a160640 1 --2- 172.21.15.6:0/1893060660 >> v2:172.21.15.89:3300/0 conn(0x7f33140ba550 0x7f33141554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a160640 1 -- 172.21.15.6:0/1893060660 >> v1:172.21.15.6:6789/0 conn(0x7f331414b1f0 legacy=0x7f33140b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331915e640 1 -- 172.21.15.6:0/1893060660 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351722813 0 0) 0x7f33140bb310 con 0x7f331414b1f0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a160640 1 -- 172.21.15.6:0/1893060660 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140c0120 con 0x7f331406a6d0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a961640 1 --2- 172.21.15.6:0/1893060660 >> v2:172.21.15.89:3300/0 conn(0x7f33140ba550 0x7f33141554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331a160640 1 --2- 172.21.15.6:0/1893060660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f331406a6d0 0x7f331414acb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f331409fcb0 tx=0x7f330c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c64dbf931f40f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.443+0000 7f331915e640 1 -- 172.21.15.6:0/1893060660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c031830 con 0x7f331406a6d0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331915e640 1 -- 172.21.15.6:0/1893060660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c031990 con 0x7f331406a6d0 2023-12-19T13:33:51.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331915e640 1 -- 172.21.15.6:0/1893060660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c031d20 con 0x7f331406a6d0 2023-12-19T13:33:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 -- 172.21.15.6:0/1893060660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f331406a6d0 msgr2=0x7f331414acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1893060660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f331406a6d0 0x7f331414acb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f331409fcb0 tx=0x7f330c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 -- 172.21.15.6:0/1893060660 shutdown_connections 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1893060660 >> v2:172.21.15.89:3300/0 conn(0x7f33140ba550 0x7f33141554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1893060660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f331406a6d0 0x7f331414acb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 -- 172.21.15.6:0/1893060660 >> 172.21.15.6:0/1893060660 conn(0x7f33140c0350 msgr2=0x7f33140c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 -- 172.21.15.6:0/1893060660 shutdown_connections 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.444+0000 7f331c3c4640 1 -- 172.21.15.6:0/1893060660 wait complete. 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.445+0000 7f331c3c4640 1 Processor -- start 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.445+0000 7f331c3c4640 1 -- start start 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331c3c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331406a6d0 0x7f331414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331c3c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 0x7f33141e0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331c3c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331414b1f0 0x7f33140a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331c3c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140a5c20 con 0x7f33140ba550 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331c3c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331414e130 con 0x7f331414b1f0 2023-12-19T13:33:51.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331c3c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331414eed0 con 0x7f331406a6d0 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 0x7f33141e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 0x7f33141e0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53426/0 (socket says 172.21.15.6:53426) 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 -- 172.21.15.6:0/1384708183 learned_addr learned my addr 172.21.15.6:0/1384708183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331a160640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331406a6d0 0x7f331414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331a961640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331414b1f0 0x7f33140a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 -- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331406a6d0 msgr2=0x7f331414bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331406a6d0 0x7f331414bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 -- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331414b1f0 msgr2=0x7f33140a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331414b1f0 0x7f33140a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 -- 172.21.15.6:0/1384708183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c009400 con 0x7f33140ba550 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331a961640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331414b1f0 0x7f33140a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:51.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.446+0000 7f331995f640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 0x7f33141e0720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f330800c410 tx=0x7f330800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.447+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33080074e0 con 0x7f33140ba550 2023-12-19T13:33:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.447+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308007660 con 0x7f33140ba550 2023-12-19T13:33:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.447+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33141dff20 con 0x7f33140ba550 2023-12-19T13:33:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.447+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308004a20 con 0x7f33140ba550 2023-12-19T13:33:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.447+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33141dfc30 con 0x7f33140ba550 2023-12-19T13:33:51.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.448+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33141e0440 con 0x7f33140ba550 2023-12-19T13:33:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.448+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3308004b80 con 0x7f33140ba550 2023-12-19T13:33:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.448+0000 7f3312ffd640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f330006a460 0x7f330006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.448+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33080886b0 con 0x7f33140ba550 2023-12-19T13:33:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.449+0000 7f331a160640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f330006a460 0x7f330006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.449+0000 7f331a160640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f330006a460 0x7f330006c920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f330c036000 tx=0x7f330c03e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.453+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f33141e0440 con 0x7f33140ba550 2023-12-19T13:33:51.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.630+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33141e0440 con 0x7f33140ba550 2023-12-19T13:33:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.631+0000 7f3312ffd640 1 -- 172.21.15.6:0/1384708183 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16005 (secure 0 0 0) 0x7f33141e0440 con 0x7f33140ba550 2023-12-19T13:33:51.633 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:51.633 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:49.344731+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T13:33:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f330006a460 msgr2=0x7f330006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f330006a460 0x7f330006c920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f330c036000 tx=0x7f330c03e040 comp rx=0 tx=0).stop 2023-12-19T13:33:51.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 msgr2=0x7f33141e0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 0x7f33141e0720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f330800c410 tx=0x7f330800c8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 shutdown_connections 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f330006a460 0x7f330006c920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331414b1f0 0x7f33140a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33140ba550 0x7f33141e0720 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 --2- 172.21.15.6:0/1384708183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331406a6d0 0x7f331414bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 >> 172.21.15.6:0/1384708183 conn(0x7f33140c0350 msgr2=0x7f33140a0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 shutdown_connections 2023-12-19T13:33:51.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.633+0000 7f331c3c4640 1 -- 172.21.15.6:0/1384708183 wait complete. 2023-12-19T13:33:51.646 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T13:33:51.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:33:51.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.750+0000 7ff9a8096640 1 Processor -- start 2023-12-19T13:33:51.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.750+0000 7ff9a8096640 1 -- start start 2023-12-19T13:33:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a8096640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a0071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a8096640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a0145340 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a8096640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a006b8e0 con 0x7ff9a014abf0 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a8096640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b81a0 con 0x7ff9a00ba480 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a5e32640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff9a00b7dc0 0x7ff9a0070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40974/0 (socket says 172.21.15.6:40974) 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a5e32640 1 -- 172.21.15.6:0/4112057138 learned_addr learned my addr 172.21.15.6:0/4112057138 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a5631640 1 --2- 172.21.15.6:0/4112057138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a4e30640 1 -- 172.21.15.6:0/4112057138 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360492918 0 0) 0x7ff9a0145340 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a4e30640 1 -- 172.21.15.6:0/4112057138 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988003520 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a4e30640 1 -- 172.21.15.6:0/4112057138 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978946901 0 0) 0x7ff9a006b8e0 con 0x7ff9a014abf0 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a5631640 1 -- 172.21.15.6:0/4112057138 >> v1:172.21.15.89:6789/0 conn(0x7ff9a014abf0 legacy=0x7ff9a014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a5631640 1 -- 172.21.15.6:0/4112057138 >> v1:172.21.15.6:6789/0 conn(0x7ff9a00b7dc0 legacy=0x7ff9a0070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.751+0000 7ff9a5631640 1 -- 172.21.15.6:0/4112057138 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00715d0 con 0x7ff9a00ba480 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.752+0000 7ff9a5631640 1 --2- 172.21.15.6:0/4112057138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a0071940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097d0 tx=0x7ff99402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=558fb37a4462ef46 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.752+0000 7ff9a4e30640 1 -- 172.21.15.6:0/4112057138 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994031890 con 0x7ff9a00ba480 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.752+0000 7ff9a4e30640 1 -- 172.21.15.6:0/4112057138 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940319f0 con 0x7ff9a00ba480 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.752+0000 7ff9a4e30640 1 -- 172.21.15.6:0/4112057138 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994031d80 con 0x7ff9a00ba480 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 -- 172.21.15.6:0/4112057138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 msgr2=0x7ff9a0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 --2- 172.21.15.6:0/4112057138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a0071940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097d0 tx=0x7ff99402b930 comp rx=0 tx=0).stop 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 -- 172.21.15.6:0/4112057138 shutdown_connections 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 --2- 172.21.15.6:0/4112057138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a0071940 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 -- 172.21.15.6:0/4112057138 >> 172.21.15.6:0/4112057138 conn(0x7ff9a00be150 msgr2=0x7ff9a00be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 -- 172.21.15.6:0/4112057138 shutdown_connections 2023-12-19T13:33:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.753+0000 7ff9a8096640 1 -- 172.21.15.6:0/4112057138 wait complete. 2023-12-19T13:33:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.754+0000 7ff9a8096640 1 Processor -- start 2023-12-19T13:33:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.754+0000 7ff9a8096640 1 -- start start 2023-12-19T13:33:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 0x7ff9a01e3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a01404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a014abf0 0x7ff9a01409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0147b40 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0148590 con 0x7ff9a014abf0 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a01e3580 con 0x7ff9a00ba480 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 0x7ff9a01e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 0x7ff9a01e3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53428/0 (socket says 172.21.15.6:53428) 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 -- 172.21.15.6:0/711284530 learned_addr learned my addr 172.21.15.6:0/711284530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5631640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a01404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a6633640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a014abf0 0x7ff9a01409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 -- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 msgr2=0x7ff9a01404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a01404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 -- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a014abf0 msgr2=0x7ff9a01409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a014abf0 0x7ff9a01409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 -- 172.21.15.6:0/711284530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994009400 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a5e32640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 0x7ff9a01e3040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c430 tx=0x7ff99800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998005ce0 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998005e40 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a01e3840 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.755+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980072f0 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.756+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a0147d90 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.756+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0073a40 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.757+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff998007450 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.757+0000 7ff99e7fc640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff98c06a460 0x7ff98c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.757+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff998087ef0 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.757+0000 7ff9a5631640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff98c06a460 0x7ff98c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.758+0000 7ff9a5631640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff98c06a460 0x7ff98c06c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff994036000 tx=0x7ff99403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.761+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff998053590 con 0x7ff9a00b7dc0 2023-12-19T13:33:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.934+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9a01e3d60 con 0x7ff98c06a460 2023-12-19T13:33:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.941+0000 7ff99e7fc640 1 -- 172.21.15.6:0/711284530 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249829 (secure 0 0 0) 0x7ff994031be0 con 0x7ff98c06a460 2023-12-19T13:33:51.946 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T13:33:51.949 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T13:33:51.944+0000 7f3e2a3e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T13:33:51.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff98c06a460 msgr2=0x7ff98c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff98c06a460 0x7ff98c06c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff994036000 tx=0x7ff99403d040 comp rx=0 tx=0).stop 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 msgr2=0x7ff9a01e3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 0x7ff9a01e3040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c430 tx=0x7ff99800c8f0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 shutdown_connections 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff98c06a460 0x7ff98c06c920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a014abf0 0x7ff9a01409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9a00ba480 0x7ff9a01404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 --2- 172.21.15.6:0/711284530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9a00b7dc0 0x7ff9a01e3040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 >> 172.21.15.6:0/711284530 conn(0x7ff9a00be150 msgr2=0x7ff9a0144640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 shutdown_connections 2023-12-19T13:33:51.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:51.944+0000 7ff9a8096640 1 -- 172.21.15.6:0/711284530 wait complete. 2023-12-19T13:33:51.956 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-19T13:33:49.960448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219104,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":3571712,"data_stored":2051522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000693"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:47.963997+0000","last_change":"2023-12-19T13:33:47.963997+0000","last_active":"2023-12-19T13:33:47.963997+0000","last_peered":"2023-12-19T13:33:47.963997+0000","last_clean":"2023-12-19T13:33:47.963997+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:47.963997+0000","last_undegraded":"2023-12-19T13:33:47.963997+0000","last_fullsized":"2023-12-19T13:33:47.963997+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T13:33:46.956678+0000","last_change":"2023-12-19T13:33:46.956678+0000","last_active":"2023-12-19T13:33:46.956678+0000","last_peered":"2023-12-19T13:33:46.956678+0000","last_clean":"2023-12-19T13:33:46.956678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T13:33:46.956678+0000","last_undegraded":"2023-12-19T13:33:46.956678+0000","last_fullsized":"2023-12-19T13:33:46.956678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-19T13:33:41.273956+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T13:33:41.273956+0000","last_peered":"2023-12-19T13:33:41.273956+0000","last_clean":"2023-12-19T13:33:41.273956+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T13:33:41.273956+0000","last_undegraded":"2023-12-19T13:33:41.273956+0000","last_fullsized":"2023-12-19T13:33:41.273956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":108084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":698452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T13:33:51.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T13:33:52.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3899547640 1 Processor -- start 2023-12-19T13:33:52.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3899547640 1 -- start start 2023-12-19T13:33:52.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3899547640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f389406a6d0 0x7f389414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3899547640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940bb310 con 0x7f389414b1f0 2023-12-19T13:33:52.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3899547640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940bf960 con 0x7f38940ba550 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3899547640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940bb5b0 con 0x7f389406a6d0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f3892ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f389406a6d0 0x7f389414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f38927fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f389414b1f0 0x7f38940b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40988/0 (socket says 172.21.15.6:40988) 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.101+0000 7f38927fc640 1 -- 172.21.15.6:0/3204550600 learned_addr learned my addr 172.21.15.6:0/3204550600 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.102+0000 7f3892ffd640 1 -- 172.21.15.6:0/3204550600 >> v1:172.21.15.89:6789/0 conn(0x7f38940ba550 legacy=0x7f38941554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.102+0000 7f3892ffd640 1 -- 172.21.15.6:0/3204550600 >> v1:172.21.15.6:6789/0 conn(0x7f389414b1f0 legacy=0x7f38940b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.102+0000 7f3891ffb640 1 -- 172.21.15.6:0/3204550600 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664591737 0 0) 0x7f38940bb310 con 0x7f389414b1f0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.102+0000 7f3892ffd640 1 -- 172.21.15.6:0/3204550600 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940c0120 con 0x7f389406a6d0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.102+0000 7f3892ffd640 1 --2- 172.21.15.6:0/3204550600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414acb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f388c0097a0 tx=0x7f388c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85addcc21c3b6abe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3891ffb640 1 -- 172.21.15.6:0/3204550600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c031830 con 0x7f389406a6d0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3891ffb640 1 -- 172.21.15.6:0/3204550600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c031990 con 0x7f389406a6d0 2023-12-19T13:33:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3891ffb640 1 -- 172.21.15.6:0/3204550600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c031d20 con 0x7f389406a6d0 2023-12-19T13:33:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 -- 172.21.15.6:0/3204550600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 msgr2=0x7f389414acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 --2- 172.21.15.6:0/3204550600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414acb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f388c0097a0 tx=0x7f388c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 -- 172.21.15.6:0/3204550600 shutdown_connections 2023-12-19T13:33:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 --2- 172.21.15.6:0/3204550600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414acb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 -- 172.21.15.6:0/3204550600 >> 172.21.15.6:0/3204550600 conn(0x7f38940c0350 msgr2=0x7f38940c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 -- 172.21.15.6:0/3204550600 shutdown_connections 2023-12-19T13:33:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.103+0000 7f3899547640 1 -- 172.21.15.6:0/3204550600 wait complete. 2023-12-19T13:33:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.104+0000 7f3899547640 1 Processor -- start 2023-12-19T13:33:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.104+0000 7f3899547640 1 -- start start 2023-12-19T13:33:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3899547640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3899547640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38940ba550 0x7f38941d5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3899547640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f389414b1f0 0x7f38940b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3899547640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389414eb90 con 0x7f389406a6d0 2023-12-19T13:33:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3899547640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38941d48e0 con 0x7f389414b1f0 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3899547640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38941d5ad0 con 0x7f38940ba550 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53438/0 (socket says 172.21.15.6:53438) 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 -- 172.21.15.6:0/722566141 learned_addr learned my addr 172.21.15.6:0/722566141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f38927fc640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38940ba550 0x7f38941d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f38937fe640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f389414b1f0 0x7f38940b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 -- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38940ba550 msgr2=0x7f38941d5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38940ba550 0x7f38941d5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 -- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f389414b1f0 msgr2=0x7f38940b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f389414b1f0 0x7f38940b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f3892ffd640 1 -- 172.21.15.6:0/722566141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009400 con 0x7f389406a6d0 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f38927fc640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38940ba550 0x7f38941d5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.105+0000 7f38937fe640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f389414b1f0 0x7f38940b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.106+0000 7f3892ffd640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414e650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f388c0097a0 tx=0x7f388c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.106+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0317d0 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.106+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c004030 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.106+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940b6fd0 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.106+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0043e0 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.106+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941d4290 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.107+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894073a40 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.107+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f388c043070 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.108+0000 7f388b7fe640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f387406a460 0x7f387406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.108+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f388c0aa630 con 0x7f389406a6d0 2023-12-19T13:33:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.108+0000 7f38927fc640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f387406a460 0x7f387406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.108+0000 7f38927fc640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f387406a460 0x7f387406c920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38940a1420 tx=0x7f387c007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.112+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f388c075cb0 con 0x7f389406a6d0 2023-12-19T13:33:52.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.284+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38940c1160 con 0x7f387406a460 2023-12-19T13:33:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.292+0000 7f388b7fe640 1 -- 172.21.15.6:0/722566141 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264662 (secure 0 0 0) 0x7f387c007270 con 0x7f387406a460 2023-12-19T13:33:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T13:33:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f387406a460 msgr2=0x7f387406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f387406a460 0x7f387406c920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38940a1420 tx=0x7f387c007c10 comp rx=0 tx=0).stop 2023-12-19T13:33:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 msgr2=0x7f389414e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414e650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f388c0097a0 tx=0x7f388c0046c0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 shutdown_connections 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f387406a460 0x7f387406c920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f389414b1f0 0x7f38940b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38940ba550 0x7f38941d5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 --2- 172.21.15.6:0/722566141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f389406a6d0 0x7f389414e650 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 >> 172.21.15.6:0/722566141 conn(0x7f38940c0350 msgr2=0x7f38940c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 shutdown_connections 2023-12-19T13:33:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.295+0000 7f3899547640 1 -- 172.21.15.6:0/722566141 wait complete. 2023-12-19T13:33:52.307 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-12-19T13:33:51.960956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3888,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3981312,"data_stored":2232318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.996413"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350274+0000","last_change":"2023-12-19T13:33:48.359232+0000","last_active":"2023-12-19T13:33:49.350274+0000","last_peered":"2023-12-19T13:33:49.350274+0000","last_clean":"2023-12-19T13:33:49.350274+0000","last_became_active":"2023-12-19T13:33:48.358940+0000","last_became_peered":"2023-12-19T13:33:48.358940+0000","last_unstale":"2023-12-19T13:33:49.350274+0000","last_undegraded":"2023-12-19T13:33:49.350274+0000","last_fullsized":"2023-12-19T13:33:49.350274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:02.124487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491402+0000","last_change":"2023-12-19T13:33:48.362477+0000","last_active":"2023-12-19T13:33:49.491402+0000","last_peered":"2023-12-19T13:33:49.491402+0000","last_clean":"2023-12-19T13:33:49.491402+0000","last_became_active":"2023-12-19T13:33:48.362233+0000","last_became_peered":"2023-12-19T13:33:48.362233+0000","last_unstale":"2023-12-19T13:33:49.491402+0000","last_undegraded":"2023-12-19T13:33:49.491402+0000","last_fullsized":"2023-12-19T13:33:49.491402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:03.996806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742208+0000","last_change":"2023-12-19T13:33:48.365655+0000","last_active":"2023-12-19T13:33:50.742208+0000","last_peered":"2023-12-19T13:33:50.742208+0000","last_clean":"2023-12-19T13:33:50.742208+0000","last_became_active":"2023-12-19T13:33:48.365408+0000","last_became_peered":"2023-12-19T13:33:48.365408+0000","last_unstale":"2023-12-19T13:33:50.742208+0000","last_undegraded":"2023-12-19T13:33:50.742208+0000","last_fullsized":"2023-12-19T13:33:50.742208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:38.716680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348520+0000","last_change":"2023-12-19T13:33:48.359240+0000","last_active":"2023-12-19T13:33:49.348520+0000","last_peered":"2023-12-19T13:33:49.348520+0000","last_clean":"2023-12-19T13:33:49.348520+0000","last_became_active":"2023-12-19T13:33:48.358988+0000","last_became_peered":"2023-12-19T13:33:48.358988+0000","last_unstale":"2023-12-19T13:33:49.348520+0000","last_undegraded":"2023-12-19T13:33:49.348520+0000","last_fullsized":"2023-12-19T13:33:49.348520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:49.871474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.771964+0000","last_change":"2023-12-19T13:33:48.367814+0000","last_active":"2023-12-19T13:33:50.771964+0000","last_peered":"2023-12-19T13:33:50.771964+0000","last_clean":"2023-12-19T13:33:50.771964+0000","last_became_active":"2023-12-19T13:33:48.367511+0000","last_became_peered":"2023-12-19T13:33:48.367511+0000","last_unstale":"2023-12-19T13:33:50.771964+0000","last_undegraded":"2023-12-19T13:33:50.771964+0000","last_fullsized":"2023-12-19T13:33:50.771964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:28.532470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491232+0000","last_change":"2023-12-19T13:33:48.361571+0000","last_active":"2023-12-19T13:33:49.491232+0000","last_peered":"2023-12-19T13:33:49.491232+0000","last_clean":"2023-12-19T13:33:49.491232+0000","last_became_active":"2023-12-19T13:33:48.361075+0000","last_became_peered":"2023-12-19T13:33:48.361075+0000","last_unstale":"2023-12-19T13:33:49.491232+0000","last_undegraded":"2023-12-19T13:33:49.491232+0000","last_fullsized":"2023-12-19T13:33:49.491232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:09.853452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.236013+0000","last_change":"2023-12-19T13:33:48.366061+0000","last_active":"2023-12-19T13:33:50.236013+0000","last_peered":"2023-12-19T13:33:50.236013+0000","last_clean":"2023-12-19T13:33:50.236013+0000","last_became_active":"2023-12-19T13:33:48.365800+0000","last_became_peered":"2023-12-19T13:33:48.365800+0000","last_unstale":"2023-12-19T13:33:50.236013+0000","last_undegraded":"2023-12-19T13:33:50.236013+0000","last_fullsized":"2023-12-19T13:33:50.236013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:32.589540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.235783+0000","last_change":"2023-12-19T13:33:48.361470+0000","last_active":"2023-12-19T13:33:50.235783+0000","last_peered":"2023-12-19T13:33:50.235783+0000","last_clean":"2023-12-19T13:33:50.235783+0000","last_became_active":"2023-12-19T13:33:48.361000+0000","last_became_peered":"2023-12-19T13:33:48.361000+0000","last_unstale":"2023-12-19T13:33:50.235783+0000","last_undegraded":"2023-12-19T13:33:50.235783+0000","last_fullsized":"2023-12-19T13:33:50.235783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:50.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349716+0000","last_change":"2023-12-19T13:33:48.360442+0000","last_active":"2023-12-19T13:33:49.349716+0000","last_peered":"2023-12-19T13:33:49.349716+0000","last_clean":"2023-12-19T13:33:49.349716+0000","last_became_active":"2023-12-19T13:33:48.360192+0000","last_became_peered":"2023-12-19T13:33:48.360192+0000","last_unstale":"2023-12-19T13:33:49.349716+0000","last_undegraded":"2023-12-19T13:33:49.349716+0000","last_fullsized":"2023-12-19T13:33:49.349716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:25.967662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348793+0000","last_change":"2023-12-19T13:33:48.364298+0000","last_active":"2023-12-19T13:33:49.348793+0000","last_peered":"2023-12-19T13:33:49.348793+0000","last_clean":"2023-12-19T13:33:49.348793+0000","last_became_active":"2023-12-19T13:33:48.364016+0000","last_became_peered":"2023-12-19T13:33:48.364016+0000","last_unstale":"2023-12-19T13:33:49.348793+0000","last_undegraded":"2023-12-19T13:33:49.348793+0000","last_fullsized":"2023-12-19T13:33:49.348793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:32.589540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.236126+0000","last_change":"2023-12-19T13:33:48.370285+0000","last_active":"2023-12-19T13:33:50.236126+0000","last_peered":"2023-12-19T13:33:50.236126+0000","last_clean":"2023-12-19T13:33:50.236126+0000","last_became_active":"2023-12-19T13:33:48.369832+0000","last_became_peered":"2023-12-19T13:33:48.369832+0000","last_unstale":"2023-12-19T13:33:50.236126+0000","last_undegraded":"2023-12-19T13:33:50.236126+0000","last_fullsized":"2023-12-19T13:33:50.236126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:43:05.033922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742142+0000","last_change":"2023-12-19T13:33:48.365052+0000","last_active":"2023-12-19T13:33:50.742142+0000","last_peered":"2023-12-19T13:33:50.742142+0000","last_clean":"2023-12-19T13:33:50.742142+0000","last_became_active":"2023-12-19T13:33:48.364780+0000","last_became_peered":"2023-12-19T13:33:48.364780+0000","last_unstale":"2023-12-19T13:33:50.742142+0000","last_undegraded":"2023-12-19T13:33:50.742142+0000","last_fullsized":"2023-12-19T13:33:50.742142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:09.853452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772081+0000","last_change":"2023-12-19T13:33:48.361032+0000","last_active":"2023-12-19T13:33:50.772081+0000","last_peered":"2023-12-19T13:33:50.772081+0000","last_clean":"2023-12-19T13:33:50.772081+0000","last_became_active":"2023-12-19T13:33:48.360780+0000","last_became_peered":"2023-12-19T13:33:48.360780+0000","last_unstale":"2023-12-19T13:33:50.772081+0000","last_undegraded":"2023-12-19T13:33:50.772081+0000","last_fullsized":"2023-12-19T13:33:50.772081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:38.621931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491113+0000","last_change":"2023-12-19T13:33:48.361383+0000","last_active":"2023-12-19T13:33:49.491113+0000","last_peered":"2023-12-19T13:33:49.491113+0000","last_clean":"2023-12-19T13:33:49.491113+0000","last_became_active":"2023-12-19T13:33:48.360747+0000","last_became_peered":"2023-12-19T13:33:48.360747+0000","last_unstale":"2023-12-19T13:33:49.491113+0000","last_undegraded":"2023-12-19T13:33:49.491113+0000","last_fullsized":"2023-12-19T13:33:49.491113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:38.716680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.741943+0000","last_change":"2023-12-19T13:33:48.362953+0000","last_active":"2023-12-19T13:33:50.741943+0000","last_peered":"2023-12-19T13:33:50.741943+0000","last_clean":"2023-12-19T13:33:50.741943+0000","last_became_active":"2023-12-19T13:33:48.362182+0000","last_became_peered":"2023-12-19T13:33:48.362182+0000","last_unstale":"2023-12-19T13:33:50.741943+0000","last_undegraded":"2023-12-19T13:33:50.741943+0000","last_fullsized":"2023-12-19T13:33:50.741943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:23.599108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.236168+0000","last_change":"2023-12-19T13:33:48.367041+0000","last_active":"2023-12-19T13:33:50.236168+0000","last_peered":"2023-12-19T13:33:50.236168+0000","last_clean":"2023-12-19T13:33:50.236168+0000","last_became_active":"2023-12-19T13:33:48.366784+0000","last_became_peered":"2023-12-19T13:33:48.366784+0000","last_unstale":"2023-12-19T13:33:50.236168+0000","last_undegraded":"2023-12-19T13:33:50.236168+0000","last_fullsized":"2023-12-19T13:33:50.236168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:47:09.853452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.236240+0000","last_change":"2023-12-19T13:33:48.368827+0000","last_active":"2023-12-19T13:33:50.236240+0000","last_peered":"2023-12-19T13:33:50.236240+0000","last_clean":"2023-12-19T13:33:50.236240+0000","last_became_active":"2023-12-19T13:33:48.368587+0000","last_became_peered":"2023-12-19T13:33:48.368587+0000","last_unstale":"2023-12-19T13:33:50.236240+0000","last_undegraded":"2023-12-19T13:33:50.236240+0000","last_fullsized":"2023-12-19T13:33:50.236240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:23.599108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491418+0000","last_change":"2023-12-19T13:33:48.366767+0000","last_active":"2023-12-19T13:33:49.491418+0000","last_peered":"2023-12-19T13:33:49.491418+0000","last_clean":"2023-12-19T13:33:49.491418+0000","last_became_active":"2023-12-19T13:33:48.366482+0000","last_became_peered":"2023-12-19T13:33:48.366482+0000","last_unstale":"2023-12-19T13:33:49.491418+0000","last_undegraded":"2023-12-19T13:33:49.491418+0000","last_fullsized":"2023-12-19T13:33:49.491418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:31.719012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491239+0000","last_change":"2023-12-19T13:33:48.365861+0000","last_active":"2023-12-19T13:33:49.491239+0000","last_peered":"2023-12-19T13:33:49.491239+0000","last_clean":"2023-12-19T13:33:49.491239+0000","last_became_active":"2023-12-19T13:33:48.365628+0000","last_became_peered":"2023-12-19T13:33:48.365628+0000","last_unstale":"2023-12-19T13:33:49.491239+0000","last_undegraded":"2023-12-19T13:33:49.491239+0000","last_fullsized":"2023-12-19T13:33:49.491239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:43:05.033922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772349+0000","last_change":"2023-12-19T13:33:48.357608+0000","last_active":"2023-12-19T13:33:50.772349+0000","last_peered":"2023-12-19T13:33:50.772349+0000","last_clean":"2023-12-19T13:33:50.772349+0000","last_became_active":"2023-12-19T13:33:48.357328+0000","last_became_peered":"2023-12-19T13:33:48.357328+0000","last_unstale":"2023-12-19T13:33:50.772349+0000","last_undegraded":"2023-12-19T13:33:50.772349+0000","last_fullsized":"2023-12-19T13:33:50.772349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:14.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350054+0000","last_change":"2023-12-19T13:33:48.363940+0000","last_active":"2023-12-19T13:33:49.350054+0000","last_peered":"2023-12-19T13:33:49.350054+0000","last_clean":"2023-12-19T13:33:49.350054+0000","last_became_active":"2023-12-19T13:33:48.363700+0000","last_became_peered":"2023-12-19T13:33:48.363700+0000","last_unstale":"2023-12-19T13:33:49.350054+0000","last_undegraded":"2023-12-19T13:33:49.350054+0000","last_fullsized":"2023-12-19T13:33:49.350054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:08.415491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350201+0000","last_change":"2023-12-19T13:33:48.366104+0000","last_active":"2023-12-19T13:33:49.350201+0000","last_peered":"2023-12-19T13:33:49.350201+0000","last_clean":"2023-12-19T13:33:49.350201+0000","last_became_active":"2023-12-19T13:33:48.365847+0000","last_became_peered":"2023-12-19T13:33:48.365847+0000","last_unstale":"2023-12-19T13:33:49.350201+0000","last_undegraded":"2023-12-19T13:33:49.350201+0000","last_fullsized":"2023-12-19T13:33:49.350201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:59.299551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.771859+0000","last_change":"2023-12-19T13:33:48.365748+0000","last_active":"2023-12-19T13:33:50.771859+0000","last_peered":"2023-12-19T13:33:50.771859+0000","last_clean":"2023-12-19T13:33:50.771859+0000","last_became_active":"2023-12-19T13:33:48.365487+0000","last_became_peered":"2023-12-19T13:33:48.365487+0000","last_unstale":"2023-12-19T13:33:50.771859+0000","last_undegraded":"2023-12-19T13:33:50.771859+0000","last_fullsized":"2023-12-19T13:33:50.771859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:25.967662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.741914+0000","last_change":"2023-12-19T13:33:48.363024+0000","last_active":"2023-12-19T13:33:50.741914+0000","last_peered":"2023-12-19T13:33:50.741914+0000","last_clean":"2023-12-19T13:33:50.741914+0000","last_became_active":"2023-12-19T13:33:48.362772+0000","last_became_peered":"2023-12-19T13:33:48.362772+0000","last_unstale":"2023-12-19T13:33:50.741914+0000","last_undegraded":"2023-12-19T13:33:50.741914+0000","last_fullsized":"2023-12-19T13:33:50.741914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:49.871474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348892+0000","last_change":"2023-12-19T13:33:48.360167+0000","last_active":"2023-12-19T13:33:49.348892+0000","last_peered":"2023-12-19T13:33:49.348892+0000","last_clean":"2023-12-19T13:33:49.348892+0000","last_became_active":"2023-12-19T13:33:48.359726+0000","last_became_peered":"2023-12-19T13:33:48.359726+0000","last_unstale":"2023-12-19T13:33:49.348892+0000","last_undegraded":"2023-12-19T13:33:49.348892+0000","last_fullsized":"2023-12-19T13:33:49.348892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:23.599108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491495+0000","last_change":"2023-12-19T13:33:48.365144+0000","last_active":"2023-12-19T13:33:49.491495+0000","last_peered":"2023-12-19T13:33:49.491495+0000","last_clean":"2023-12-19T13:33:49.491495+0000","last_became_active":"2023-12-19T13:33:48.364897+0000","last_became_peered":"2023-12-19T13:33:48.364897+0000","last_unstale":"2023-12-19T13:33:49.491495+0000","last_undegraded":"2023-12-19T13:33:49.491495+0000","last_fullsized":"2023-12-19T13:33:49.491495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:55.691836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348834+0000","last_change":"2023-12-19T13:33:48.353549+0000","last_active":"2023-12-19T13:33:49.348834+0000","last_peered":"2023-12-19T13:33:49.348834+0000","last_clean":"2023-12-19T13:33:49.348834+0000","last_became_active":"2023-12-19T13:33:48.353295+0000","last_became_peered":"2023-12-19T13:33:48.353295+0000","last_unstale":"2023-12-19T13:33:49.348834+0000","last_undegraded":"2023-12-19T13:33:49.348834+0000","last_fullsized":"2023-12-19T13:33:49.348834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:50.302901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742177+0000","last_change":"2023-12-19T13:33:48.363130+0000","last_active":"2023-12-19T13:33:50.742177+0000","last_peered":"2023-12-19T13:33:50.742177+0000","last_clean":"2023-12-19T13:33:50.742177+0000","last_became_active":"2023-12-19T13:33:48.362159+0000","last_became_peered":"2023-12-19T13:33:48.362159+0000","last_unstale":"2023-12-19T13:33:50.742177+0000","last_undegraded":"2023-12-19T13:33:50.742177+0000","last_fullsized":"2023-12-19T13:33:50.742177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:49:32.589540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350137+0000","last_change":"2023-12-19T13:33:48.366024+0000","last_active":"2023-12-19T13:33:49.350137+0000","last_peered":"2023-12-19T13:33:49.350137+0000","last_clean":"2023-12-19T13:33:49.350137+0000","last_became_active":"2023-12-19T13:33:48.365760+0000","last_became_peered":"2023-12-19T13:33:48.365760+0000","last_unstale":"2023-12-19T13:33:49.350137+0000","last_undegraded":"2023-12-19T13:33:49.350137+0000","last_fullsized":"2023-12-19T13:33:49.350137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:52.085776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.235927+0000","last_change":"2023-12-19T13:33:48.366116+0000","last_active":"2023-12-19T13:33:50.235927+0000","last_peered":"2023-12-19T13:33:50.235927+0000","last_clean":"2023-12-19T13:33:50.235927+0000","last_became_active":"2023-12-19T13:33:48.365843+0000","last_became_peered":"2023-12-19T13:33:48.365843+0000","last_unstale":"2023-12-19T13:33:50.235927+0000","last_undegraded":"2023-12-19T13:33:50.235927+0000","last_fullsized":"2023-12-19T13:33:50.235927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:50.302901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349703+0000","last_change":"2023-12-19T13:33:48.357524+0000","last_active":"2023-12-19T13:33:49.349703+0000","last_peered":"2023-12-19T13:33:49.349703+0000","last_clean":"2023-12-19T13:33:49.349703+0000","last_became_active":"2023-12-19T13:33:48.357264+0000","last_became_peered":"2023-12-19T13:33:48.357264+0000","last_unstale":"2023-12-19T13:33:49.349703+0000","last_undegraded":"2023-12-19T13:33:49.349703+0000","last_fullsized":"2023-12-19T13:33:49.349703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:59.299551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.235784+0000","last_change":"2023-12-19T13:33:48.359021+0000","last_active":"2023-12-19T13:33:50.235784+0000","last_peered":"2023-12-19T13:33:50.235784+0000","last_clean":"2023-12-19T13:33:50.235784+0000","last_became_active":"2023-12-19T13:33:48.358763+0000","last_became_peered":"2023-12-19T13:33:48.358763+0000","last_unstale":"2023-12-19T13:33:50.235784+0000","last_undegraded":"2023-12-19T13:33:50.235784+0000","last_fullsized":"2023-12-19T13:33:50.235784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:03.996806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.771970+0000","last_change":"2023-12-19T13:33:48.365749+0000","last_active":"2023-12-19T13:33:50.771970+0000","last_peered":"2023-12-19T13:33:50.771970+0000","last_clean":"2023-12-19T13:33:50.771970+0000","last_became_active":"2023-12-19T13:33:48.365527+0000","last_became_peered":"2023-12-19T13:33:48.365527+0000","last_unstale":"2023-12-19T13:33:50.771970+0000","last_undegraded":"2023-12-19T13:33:50.771970+0000","last_fullsized":"2023-12-19T13:33:50.771970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:08.415491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350379+0000","last_change":"2023-12-19T13:33:47.981008+0000","last_active":"2023-12-19T13:33:49.350379+0000","last_peered":"2023-12-19T13:33:49.350379+0000","last_clean":"2023-12-19T13:33:49.350379+0000","last_became_active":"2023-12-19T13:33:47.980726+0000","last_became_peered":"2023-12-19T13:33:47.980726+0000","last_unstale":"2023-12-19T13:33:49.350379+0000","last_undegraded":"2023-12-19T13:33:49.350379+0000","last_fullsized":"2023-12-19T13:33:49.350379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:15.361315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350304+0000","last_change":"2023-12-19T13:33:48.356279+0000","last_active":"2023-12-19T13:33:49.350304+0000","last_peered":"2023-12-19T13:33:49.350304+0000","last_clean":"2023-12-19T13:33:49.350304+0000","last_became_active":"2023-12-19T13:33:48.355666+0000","last_became_peered":"2023-12-19T13:33:48.355666+0000","last_unstale":"2023-12-19T13:33:49.350304+0000","last_undegraded":"2023-12-19T13:33:49.350304+0000","last_fullsized":"2023-12-19T13:33:49.350304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:57.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772068+0000","last_change":"2023-12-19T13:33:47.989962+0000","last_active":"2023-12-19T13:33:50.772068+0000","last_peered":"2023-12-19T13:33:50.772068+0000","last_clean":"2023-12-19T13:33:50.772068+0000","last_became_active":"2023-12-19T13:33:47.989715+0000","last_became_peered":"2023-12-19T13:33:47.989715+0000","last_unstale":"2023-12-19T13:33:50.772068+0000","last_undegraded":"2023-12-19T13:33:50.772068+0000","last_fullsized":"2023-12-19T13:33:50.772068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:44.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349980+0000","last_change":"2023-12-19T13:33:48.367108+0000","last_active":"2023-12-19T13:33:49.349980+0000","last_peered":"2023-12-19T13:33:49.349980+0000","last_clean":"2023-12-19T13:33:49.349980+0000","last_became_active":"2023-12-19T13:33:48.366844+0000","last_became_peered":"2023-12-19T13:33:48.366844+0000","last_unstale":"2023-12-19T13:33:49.349980+0000","last_undegraded":"2023-12-19T13:33:49.349980+0000","last_fullsized":"2023-12-19T13:33:49.349980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:25.234492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491277+0000","last_change":"2023-12-19T13:33:47.990293+0000","last_active":"2023-12-19T13:33:49.491277+0000","last_peered":"2023-12-19T13:33:49.491277+0000","last_clean":"2023-12-19T13:33:49.491277+0000","last_became_active":"2023-12-19T13:33:47.989785+0000","last_became_peered":"2023-12-19T13:33:47.989785+0000","last_unstale":"2023-12-19T13:33:49.491277+0000","last_undegraded":"2023-12-19T13:33:49.491277+0000","last_fullsized":"2023-12-19T13:33:49.491277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:20.039001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348851+0000","last_change":"2023-12-19T13:33:48.354139+0000","last_active":"2023-12-19T13:33:49.348851+0000","last_peered":"2023-12-19T13:33:49.348851+0000","last_clean":"2023-12-19T13:33:49.348851+0000","last_became_active":"2023-12-19T13:33:48.353898+0000","last_became_peered":"2023-12-19T13:33:48.353898+0000","last_unstale":"2023-12-19T13:33:49.348851+0000","last_undegraded":"2023-12-19T13:33:49.348851+0000","last_fullsized":"2023-12-19T13:33:49.348851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:25.967662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772348+0000","last_change":"2023-12-19T13:33:47.986597+0000","last_active":"2023-12-19T13:33:50.772348+0000","last_peered":"2023-12-19T13:33:50.772348+0000","last_clean":"2023-12-19T13:33:50.772348+0000","last_became_active":"2023-12-19T13:33:47.986273+0000","last_became_peered":"2023-12-19T13:33:47.986273+0000","last_unstale":"2023-12-19T13:33:50.772348+0000","last_undegraded":"2023-12-19T13:33:50.772348+0000","last_fullsized":"2023-12-19T13:33:50.772348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:20.838584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.235947+0000","last_change":"2023-12-19T13:33:48.361387+0000","last_active":"2023-12-19T13:33:50.235947+0000","last_peered":"2023-12-19T13:33:50.235947+0000","last_clean":"2023-12-19T13:33:50.235947+0000","last_became_active":"2023-12-19T13:33:48.361135+0000","last_became_peered":"2023-12-19T13:33:48.361135+0000","last_unstale":"2023-12-19T13:33:50.235947+0000","last_undegraded":"2023-12-19T13:33:50.235947+0000","last_fullsized":"2023-12-19T13:33:50.235947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:57.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350521+0000","last_change":"2023-12-19T13:33:47.983418+0000","last_active":"2023-12-19T13:33:49.350521+0000","last_peered":"2023-12-19T13:33:49.350521+0000","last_clean":"2023-12-19T13:33:49.350521+0000","last_became_active":"2023-12-19T13:33:47.983131+0000","last_became_peered":"2023-12-19T13:33:47.983131+0000","last_unstale":"2023-12-19T13:33:49.350521+0000","last_undegraded":"2023-12-19T13:33:49.350521+0000","last_fullsized":"2023-12-19T13:33:49.350521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:13.273920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742088+0000","last_change":"2023-12-19T13:33:48.364021+0000","last_active":"2023-12-19T13:33:50.742088+0000","last_peered":"2023-12-19T13:33:50.742088+0000","last_clean":"2023-12-19T13:33:50.742088+0000","last_became_active":"2023-12-19T13:33:48.363709+0000","last_became_peered":"2023-12-19T13:33:48.363709+0000","last_unstale":"2023-12-19T13:33:50.742088+0000","last_undegraded":"2023-12-19T13:33:50.742088+0000","last_fullsized":"2023-12-19T13:33:50.742088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:43:05.033922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350303+0000","last_change":"2023-12-19T13:33:47.985888+0000","last_active":"2023-12-19T13:33:49.350303+0000","last_peered":"2023-12-19T13:33:49.350303+0000","last_clean":"2023-12-19T13:33:49.350303+0000","last_became_active":"2023-12-19T13:33:47.985640+0000","last_became_peered":"2023-12-19T13:33:47.985640+0000","last_unstale":"2023-12-19T13:33:49.350303+0000","last_undegraded":"2023-12-19T13:33:49.350303+0000","last_fullsized":"2023-12-19T13:33:49.350303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:27.525151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349468+0000","last_change":"2023-12-19T13:33:48.362208+0000","last_active":"2023-12-19T13:33:49.349468+0000","last_peered":"2023-12-19T13:33:49.349468+0000","last_clean":"2023-12-19T13:33:49.349468+0000","last_became_active":"2023-12-19T13:33:48.361964+0000","last_became_peered":"2023-12-19T13:33:48.361964+0000","last_unstale":"2023-12-19T13:33:49.349468+0000","last_undegraded":"2023-12-19T13:33:49.349468+0000","last_fullsized":"2023-12-19T13:33:49.349468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:57.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491011+0000","last_change":"2023-12-19T13:33:47.983792+0000","last_active":"2023-12-19T13:33:49.491011+0000","last_peered":"2023-12-19T13:33:49.491011+0000","last_clean":"2023-12-19T13:33:49.491011+0000","last_became_active":"2023-12-19T13:33:47.983486+0000","last_became_peered":"2023-12-19T13:33:47.983486+0000","last_unstale":"2023-12-19T13:33:49.491011+0000","last_undegraded":"2023-12-19T13:33:49.491011+0000","last_fullsized":"2023-12-19T13:33:49.491011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:55.329526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348393+0000","last_change":"2023-12-19T13:33:48.358245+0000","last_active":"2023-12-19T13:33:49.348393+0000","last_peered":"2023-12-19T13:33:49.348393+0000","last_clean":"2023-12-19T13:33:49.348393+0000","last_became_active":"2023-12-19T13:33:48.357985+0000","last_became_peered":"2023-12-19T13:33:48.357985+0000","last_unstale":"2023-12-19T13:33:49.348393+0000","last_undegraded":"2023-12-19T13:33:49.348393+0000","last_fullsized":"2023-12-19T13:33:49.348393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:34:43.099298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349553+0000","last_change":"2023-12-19T13:33:47.982100+0000","last_active":"2023-12-19T13:33:49.349553+0000","last_peered":"2023-12-19T13:33:49.349553+0000","last_clean":"2023-12-19T13:33:49.349553+0000","last_became_active":"2023-12-19T13:33:47.981824+0000","last_became_peered":"2023-12-19T13:33:47.981824+0000","last_unstale":"2023-12-19T13:33:49.349553+0000","last_undegraded":"2023-12-19T13:33:49.349553+0000","last_fullsized":"2023-12-19T13:33:49.349553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:20.838584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742350+0000","last_change":"2023-12-19T13:33:48.364354+0000","last_active":"2023-12-19T13:33:50.742350+0000","last_peered":"2023-12-19T13:33:50.742350+0000","last_clean":"2023-12-19T13:33:50.742350+0000","last_became_active":"2023-12-19T13:33:48.364085+0000","last_became_peered":"2023-12-19T13:33:48.364085+0000","last_unstale":"2023-12-19T13:33:50.742350+0000","last_undegraded":"2023-12-19T13:33:50.742350+0000","last_fullsized":"2023-12-19T13:33:50.742350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:34:43.099298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491459+0000","last_change":"2023-12-19T13:33:47.989264+0000","last_active":"2023-12-19T13:33:49.491459+0000","last_peered":"2023-12-19T13:33:49.491459+0000","last_clean":"2023-12-19T13:33:49.491459+0000","last_became_active":"2023-12-19T13:33:47.988985+0000","last_became_peered":"2023-12-19T13:33:47.988985+0000","last_unstale":"2023-12-19T13:33:49.491459+0000","last_undegraded":"2023-12-19T13:33:49.491459+0000","last_fullsized":"2023-12-19T13:33:49.491459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:14.664151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491424+0000","last_change":"2023-12-19T13:33:48.367267+0000","last_active":"2023-12-19T13:33:49.491424+0000","last_peered":"2023-12-19T13:33:49.491424+0000","last_clean":"2023-12-19T13:33:49.491424+0000","last_became_active":"2023-12-19T13:33:48.366884+0000","last_became_peered":"2023-12-19T13:33:48.366884+0000","last_unstale":"2023-12-19T13:33:49.491424+0000","last_undegraded":"2023-12-19T13:33:49.491424+0000","last_fullsized":"2023-12-19T13:33:49.491424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:46.084503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772157+0000","last_change":"2023-12-19T13:33:47.988006+0000","last_active":"2023-12-19T13:33:50.772157+0000","last_peered":"2023-12-19T13:33:50.772157+0000","last_clean":"2023-12-19T13:33:50.772157+0000","last_became_active":"2023-12-19T13:33:47.987729+0000","last_became_peered":"2023-12-19T13:33:47.987729+0000","last_unstale":"2023-12-19T13:33:50.772157+0000","last_undegraded":"2023-12-19T13:33:50.772157+0000","last_fullsized":"2023-12-19T13:33:50.772157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:55.329526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491313+0000","last_change":"2023-12-19T13:33:48.367553+0000","last_active":"2023-12-19T13:33:49.491313+0000","last_peered":"2023-12-19T13:33:49.491313+0000","last_clean":"2023-12-19T13:33:49.491313+0000","last_became_active":"2023-12-19T13:33:48.367020+0000","last_became_peered":"2023-12-19T13:33:48.367020+0000","last_unstale":"2023-12-19T13:33:49.491313+0000","last_undegraded":"2023-12-19T13:33:49.491313+0000","last_fullsized":"2023-12-19T13:33:49.491313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:50.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742309+0000","last_change":"2023-12-19T13:33:47.989180+0000","last_active":"2023-12-19T13:33:50.742309+0000","last_peered":"2023-12-19T13:33:50.742309+0000","last_clean":"2023-12-19T13:33:50.742309+0000","last_became_active":"2023-12-19T13:33:47.988898+0000","last_became_peered":"2023-12-19T13:33:47.988898+0000","last_unstale":"2023-12-19T13:33:50.742309+0000","last_undegraded":"2023-12-19T13:33:50.742309+0000","last_fullsized":"2023-12-19T13:33:50.742309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:55.329526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742186+0000","last_change":"2023-12-19T13:33:48.364651+0000","last_active":"2023-12-19T13:33:50.742186+0000","last_peered":"2023-12-19T13:33:50.742186+0000","last_clean":"2023-12-19T13:33:50.742186+0000","last_became_active":"2023-12-19T13:33:48.364389+0000","last_became_peered":"2023-12-19T13:33:48.364389+0000","last_unstale":"2023-12-19T13:33:50.742186+0000","last_undegraded":"2023-12-19T13:33:50.742186+0000","last_fullsized":"2023-12-19T13:33:50.742186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:03.996806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491317+0000","last_change":"2023-12-19T13:33:47.990477+0000","last_active":"2023-12-19T13:33:49.491317+0000","last_peered":"2023-12-19T13:33:49.491317+0000","last_clean":"2023-12-19T13:33:49.491317+0000","last_became_active":"2023-12-19T13:33:47.990220+0000","last_became_peered":"2023-12-19T13:33:47.990220+0000","last_unstale":"2023-12-19T13:33:49.491317+0000","last_undegraded":"2023-12-19T13:33:49.491317+0000","last_fullsized":"2023-12-19T13:33:49.491317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:18.292967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348418+0000","last_change":"2023-12-19T13:33:48.364408+0000","last_active":"2023-12-19T13:33:49.348418+0000","last_peered":"2023-12-19T13:33:49.348418+0000","last_clean":"2023-12-19T13:33:49.348418+0000","last_became_active":"2023-12-19T13:33:48.364127+0000","last_became_peered":"2023-12-19T13:33:48.364127+0000","last_unstale":"2023-12-19T13:33:49.348418+0000","last_undegraded":"2023-12-19T13:33:49.348418+0000","last_fullsized":"2023-12-19T13:33:49.348418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:38.694500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350524+0000","last_change":"2023-12-19T13:33:47.982124+0000","last_active":"2023-12-19T13:33:49.350524+0000","last_peered":"2023-12-19T13:33:49.350524+0000","last_clean":"2023-12-19T13:33:49.350524+0000","last_became_active":"2023-12-19T13:33:47.981861+0000","last_became_peered":"2023-12-19T13:33:47.981861+0000","last_unstale":"2023-12-19T13:33:49.350524+0000","last_undegraded":"2023-12-19T13:33:49.350524+0000","last_fullsized":"2023-12-19T13:33:49.350524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:18.115629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491204+0000","last_change":"2023-12-19T13:33:48.363878+0000","last_active":"2023-12-19T13:33:49.491204+0000","last_peered":"2023-12-19T13:33:49.491204+0000","last_clean":"2023-12-19T13:33:49.491204+0000","last_became_active":"2023-12-19T13:33:48.363643+0000","last_became_peered":"2023-12-19T13:33:48.363643+0000","last_unstale":"2023-12-19T13:33:49.491204+0000","last_undegraded":"2023-12-19T13:33:49.491204+0000","last_fullsized":"2023-12-19T13:33:49.491204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:09:40.471881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348404+0000","last_change":"2023-12-19T13:33:47.988257+0000","last_active":"2023-12-19T13:33:49.348404+0000","last_peered":"2023-12-19T13:33:49.348404+0000","last_clean":"2023-12-19T13:33:49.348404+0000","last_became_active":"2023-12-19T13:33:47.986874+0000","last_became_peered":"2023-12-19T13:33:47.986874+0000","last_unstale":"2023-12-19T13:33:49.348404+0000","last_undegraded":"2023-12-19T13:33:49.348404+0000","last_fullsized":"2023-12-19T13:33:49.348404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:15.361315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.235898+0000","last_change":"2023-12-19T13:33:48.358379+0000","last_active":"2023-12-19T13:33:50.235898+0000","last_peered":"2023-12-19T13:33:50.235898+0000","last_clean":"2023-12-19T13:33:50.235898+0000","last_became_active":"2023-12-19T13:33:48.358098+0000","last_became_peered":"2023-12-19T13:33:48.358098+0000","last_unstale":"2023-12-19T13:33:50.235898+0000","last_undegraded":"2023-12-19T13:33:50.235898+0000","last_fullsized":"2023-12-19T13:33:50.235898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:38.716680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491082+0000","last_change":"2023-12-19T13:33:47.989920+0000","last_active":"2023-12-19T13:33:49.491082+0000","last_peered":"2023-12-19T13:33:49.491082+0000","last_clean":"2023-12-19T13:33:49.491082+0000","last_became_active":"2023-12-19T13:33:47.989637+0000","last_became_peered":"2023-12-19T13:33:47.989637+0000","last_unstale":"2023-12-19T13:33:49.491082+0000","last_undegraded":"2023-12-19T13:33:49.491082+0000","last_fullsized":"2023-12-19T13:33:49.491082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:58.292232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349805+0000","last_change":"2023-12-19T13:33:48.360686+0000","last_active":"2023-12-19T13:33:49.349805+0000","last_peered":"2023-12-19T13:33:49.349805+0000","last_clean":"2023-12-19T13:33:49.349805+0000","last_became_active":"2023-12-19T13:33:48.360368+0000","last_became_peered":"2023-12-19T13:33:48.360368+0000","last_unstale":"2023-12-19T13:33:49.349805+0000","last_undegraded":"2023-12-19T13:33:49.349805+0000","last_fullsized":"2023-12-19T13:33:49.349805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:15.671470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491157+0000","last_change":"2023-12-19T13:33:47.988039+0000","last_active":"2023-12-19T13:33:49.491157+0000","last_peered":"2023-12-19T13:33:49.491157+0000","last_clean":"2023-12-19T13:33:49.491157+0000","last_became_active":"2023-12-19T13:33:47.985561+0000","last_became_peered":"2023-12-19T13:33:47.985561+0000","last_unstale":"2023-12-19T13:33:49.491157+0000","last_undegraded":"2023-12-19T13:33:49.491157+0000","last_fullsized":"2023-12-19T13:33:49.491157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:44.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349610+0000","last_change":"2023-12-19T13:33:48.357909+0000","last_active":"2023-12-19T13:33:49.349610+0000","last_peered":"2023-12-19T13:33:49.349610+0000","last_clean":"2023-12-19T13:33:49.349610+0000","last_became_active":"2023-12-19T13:33:48.357253+0000","last_became_peered":"2023-12-19T13:33:48.357253+0000","last_unstale":"2023-12-19T13:33:49.349610+0000","last_undegraded":"2023-12-19T13:33:49.349610+0000","last_fullsized":"2023-12-19T13:33:49.349610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:02.124487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348973+0000","last_change":"2023-12-19T13:33:47.990208+0000","last_active":"2023-12-19T13:33:49.348973+0000","last_peered":"2023-12-19T13:33:49.348973+0000","last_clean":"2023-12-19T13:33:49.348973+0000","last_became_active":"2023-12-19T13:33:47.989938+0000","last_became_peered":"2023-12-19T13:33:47.989938+0000","last_unstale":"2023-12-19T13:33:49.348973+0000","last_undegraded":"2023-12-19T13:33:49.348973+0000","last_fullsized":"2023-12-19T13:33:49.348973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:20.039001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742380+0000","last_change":"2023-12-19T13:33:48.366578+0000","last_active":"2023-12-19T13:33:50.742380+0000","last_peered":"2023-12-19T13:33:50.742380+0000","last_clean":"2023-12-19T13:33:50.742380+0000","last_became_active":"2023-12-19T13:33:48.366329+0000","last_became_peered":"2023-12-19T13:33:48.366329+0000","last_unstale":"2023-12-19T13:33:50.742380+0000","last_undegraded":"2023-12-19T13:33:50.742380+0000","last_fullsized":"2023-12-19T13:33:50.742380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:51:38.694500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349702+0000","last_change":"2023-12-19T13:33:47.982724+0000","last_active":"2023-12-19T13:33:49.349702+0000","last_peered":"2023-12-19T13:33:49.349702+0000","last_clean":"2023-12-19T13:33:49.349702+0000","last_became_active":"2023-12-19T13:33:47.982437+0000","last_became_peered":"2023-12-19T13:33:47.982437+0000","last_unstale":"2023-12-19T13:33:49.349702+0000","last_undegraded":"2023-12-19T13:33:49.349702+0000","last_fullsized":"2023-12-19T13:33:49.349702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:53.083818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348622+0000","last_change":"2023-12-19T13:33:48.357866+0000","last_active":"2023-12-19T13:33:49.348622+0000","last_peered":"2023-12-19T13:33:49.348622+0000","last_clean":"2023-12-19T13:33:49.348622+0000","last_became_active":"2023-12-19T13:33:48.354466+0000","last_became_peered":"2023-12-19T13:33:48.354466+0000","last_unstale":"2023-12-19T13:33:49.348622+0000","last_undegraded":"2023-12-19T13:33:49.348622+0000","last_fullsized":"2023-12-19T13:33:49.348622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:13:08.415491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350260+0000","last_change":"2023-12-19T13:33:47.982968+0000","last_active":"2023-12-19T13:33:49.350260+0000","last_peered":"2023-12-19T13:33:49.350260+0000","last_clean":"2023-12-19T13:33:49.350260+0000","last_became_active":"2023-12-19T13:33:47.982704+0000","last_became_peered":"2023-12-19T13:33:47.982704+0000","last_unstale":"2023-12-19T13:33:49.350260+0000","last_undegraded":"2023-12-19T13:33:49.350260+0000","last_fullsized":"2023-12-19T13:33:49.350260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:53:14.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772345+0000","last_change":"2023-12-19T13:33:48.358551+0000","last_active":"2023-12-19T13:33:50.772345+0000","last_peered":"2023-12-19T13:33:50.772345+0000","last_clean":"2023-12-19T13:33:50.772345+0000","last_became_active":"2023-12-19T13:33:48.358270+0000","last_became_peered":"2023-12-19T13:33:48.358270+0000","last_unstale":"2023-12-19T13:33:50.772345+0000","last_undegraded":"2023-12-19T13:33:50.772345+0000","last_fullsized":"2023-12-19T13:33:50.772345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:44:16.368634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350402+0000","last_change":"2023-12-19T13:33:47.987731+0000","last_active":"2023-12-19T13:33:49.350402+0000","last_peered":"2023-12-19T13:33:49.350402+0000","last_clean":"2023-12-19T13:33:49.350402+0000","last_became_active":"2023-12-19T13:33:47.987488+0000","last_became_peered":"2023-12-19T13:33:47.987488+0000","last_unstale":"2023-12-19T13:33:49.350402+0000","last_undegraded":"2023-12-19T13:33:49.350402+0000","last_fullsized":"2023-12-19T13:33:49.350402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:26:08.601997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772073+0000","last_change":"2023-12-19T13:33:48.359558+0000","last_active":"2023-12-19T13:33:50.772073+0000","last_peered":"2023-12-19T13:33:50.772073+0000","last_clean":"2023-12-19T13:33:50.772073+0000","last_became_active":"2023-12-19T13:33:48.359290+0000","last_became_peered":"2023-12-19T13:33:48.359290+0000","last_unstale":"2023-12-19T13:33:50.772073+0000","last_undegraded":"2023-12-19T13:33:50.772073+0000","last_fullsized":"2023-12-19T13:33:50.772073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:26:09.609316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772207+0000","last_change":"2023-12-19T13:33:47.992873+0000","last_active":"2023-12-19T13:33:50.772207+0000","last_peered":"2023-12-19T13:33:50.772207+0000","last_clean":"2023-12-19T13:33:50.772207+0000","last_became_active":"2023-12-19T13:33:47.992587+0000","last_became_peered":"2023-12-19T13:33:47.992587+0000","last_unstale":"2023-12-19T13:33:50.772207+0000","last_undegraded":"2023-12-19T13:33:50.772207+0000","last_fullsized":"2023-12-19T13:33:50.772207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:13:18.292967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772163+0000","last_change":"2023-12-19T13:33:48.363008+0000","last_active":"2023-12-19T13:33:50.772163+0000","last_peered":"2023-12-19T13:33:50.772163+0000","last_clean":"2023-12-19T13:33:50.772163+0000","last_became_active":"2023-12-19T13:33:48.362760+0000","last_became_peered":"2023-12-19T13:33:48.362760+0000","last_unstale":"2023-12-19T13:33:50.772163+0000","last_undegraded":"2023-12-19T13:33:50.772163+0000","last_fullsized":"2023-12-19T13:33:50.772163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:50:36.824545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350111+0000","last_change":"2023-12-19T13:33:47.986753+0000","last_active":"2023-12-19T13:33:49.350111+0000","last_peered":"2023-12-19T13:33:49.350111+0000","last_clean":"2023-12-19T13:33:49.350111+0000","last_became_active":"2023-12-19T13:33:47.986479+0000","last_became_peered":"2023-12-19T13:33:47.986479+0000","last_unstale":"2023-12-19T13:33:49.350111+0000","last_undegraded":"2023-12-19T13:33:49.350111+0000","last_fullsized":"2023-12-19T13:33:49.350111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:37.614612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772007+0000","last_change":"2023-12-19T13:33:48.362113+0000","last_active":"2023-12-19T13:33:50.772007+0000","last_peered":"2023-12-19T13:33:50.772007+0000","last_clean":"2023-12-19T13:33:50.772007+0000","last_became_active":"2023-12-19T13:33:48.361849+0000","last_became_peered":"2023-12-19T13:33:48.361849+0000","last_unstale":"2023-12-19T13:33:50.772007+0000","last_undegraded":"2023-12-19T13:33:50.772007+0000","last_fullsized":"2023-12-19T13:33:50.772007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:02.329508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350047+0000","last_change":"2023-12-19T13:33:47.986737+0000","last_active":"2023-12-19T13:33:49.350047+0000","last_peered":"2023-12-19T13:33:49.350047+0000","last_clean":"2023-12-19T13:33:49.350047+0000","last_became_active":"2023-12-19T13:33:47.986317+0000","last_became_peered":"2023-12-19T13:33:47.986317+0000","last_unstale":"2023-12-19T13:33:49.350047+0000","last_undegraded":"2023-12-19T13:33:49.350047+0000","last_fullsized":"2023-12-19T13:33:49.350047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:53.728874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.235949+0000","last_change":"2023-12-19T13:33:48.362651+0000","last_active":"2023-12-19T13:33:50.235949+0000","last_peered":"2023-12-19T13:33:50.235949+0000","last_clean":"2023-12-19T13:33:50.235949+0000","last_became_active":"2023-12-19T13:33:48.362398+0000","last_became_peered":"2023-12-19T13:33:48.362398+0000","last_unstale":"2023-12-19T13:33:50.235949+0000","last_undegraded":"2023-12-19T13:33:50.235949+0000","last_fullsized":"2023-12-19T13:33:50.235949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:39:49.871474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.741892+0000","last_change":"2023-12-19T13:33:47.989908+0000","last_active":"2023-12-19T13:33:50.741892+0000","last_peered":"2023-12-19T13:33:50.741892+0000","last_clean":"2023-12-19T13:33:50.741892+0000","last_became_active":"2023-12-19T13:33:47.989647+0000","last_became_peered":"2023-12-19T13:33:47.989647+0000","last_unstale":"2023-12-19T13:33:50.741892+0000","last_undegraded":"2023-12-19T13:33:50.741892+0000","last_fullsized":"2023-12-19T13:33:50.741892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:11.514415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772270+0000","last_change":"2023-12-19T13:33:48.361352+0000","last_active":"2023-12-19T13:33:50.772270+0000","last_peered":"2023-12-19T13:33:50.772270+0000","last_clean":"2023-12-19T13:33:50.772270+0000","last_became_active":"2023-12-19T13:33:48.357315+0000","last_became_peered":"2023-12-19T13:33:48.357315+0000","last_unstale":"2023-12-19T13:33:50.772270+0000","last_undegraded":"2023-12-19T13:33:50.772270+0000","last_fullsized":"2023-12-19T13:33:50.772270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:53:15.686203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348993+0000","last_change":"2023-12-19T13:33:47.985209+0000","last_active":"2023-12-19T13:33:49.348993+0000","last_peered":"2023-12-19T13:33:49.348993+0000","last_clean":"2023-12-19T13:33:49.348993+0000","last_became_active":"2023-12-19T13:33:47.984934+0000","last_became_peered":"2023-12-19T13:33:47.984934+0000","last_unstale":"2023-12-19T13:33:49.348993+0000","last_undegraded":"2023-12-19T13:33:49.348993+0000","last_fullsized":"2023-12-19T13:33:49.348993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:24:53.850954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.742381+0000","last_change":"2023-12-19T13:33:48.365677+0000","last_active":"2023-12-19T13:33:50.742381+0000","last_peered":"2023-12-19T13:33:50.742381+0000","last_clean":"2023-12-19T13:33:50.742381+0000","last_became_active":"2023-12-19T13:33:48.365461+0000","last_became_peered":"2023-12-19T13:33:48.365461+0000","last_unstale":"2023-12-19T13:33:50.742381+0000","last_undegraded":"2023-12-19T13:33:50.742381+0000","last_fullsized":"2023-12-19T13:33:50.742381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:06:50.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772218+0000","last_change":"2023-12-19T13:33:47.991056+0000","last_active":"2023-12-19T13:33:50.772218+0000","last_peered":"2023-12-19T13:33:50.772218+0000","last_clean":"2023-12-19T13:33:50.772218+0000","last_became_active":"2023-12-19T13:33:47.990759+0000","last_became_peered":"2023-12-19T13:33:47.990759+0000","last_unstale":"2023-12-19T13:33:50.772218+0000","last_undegraded":"2023-12-19T13:33:50.772218+0000","last_fullsized":"2023-12-19T13:33:50.772218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:11.514415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772059+0000","last_change":"2023-12-19T13:33:48.369994+0000","last_active":"2023-12-19T13:33:50.772059+0000","last_peered":"2023-12-19T13:33:50.772059+0000","last_clean":"2023-12-19T13:33:50.772059+0000","last_became_active":"2023-12-19T13:33:48.369731+0000","last_became_peered":"2023-12-19T13:33:48.369731+0000","last_unstale":"2023-12-19T13:33:50.772059+0000","last_undegraded":"2023-12-19T13:33:50.772059+0000","last_fullsized":"2023-12-19T13:33:50.772059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:52.085776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348759+0000","last_change":"2023-12-19T13:33:47.984302+0000","last_active":"2023-12-19T13:33:49.348759+0000","last_peered":"2023-12-19T13:33:49.348759+0000","last_clean":"2023-12-19T13:33:49.348759+0000","last_became_active":"2023-12-19T13:33:47.984007+0000","last_became_peered":"2023-12-19T13:33:47.984007+0000","last_unstale":"2023-12-19T13:33:49.348759+0000","last_undegraded":"2023-12-19T13:33:49.348759+0000","last_fullsized":"2023-12-19T13:33:49.348759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:50:35.817226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350040+0000","last_change":"2023-12-19T13:33:48.363136+0000","last_active":"2023-12-19T13:33:49.350040+0000","last_peered":"2023-12-19T13:33:49.350040+0000","last_clean":"2023-12-19T13:33:49.350040+0000","last_became_active":"2023-12-19T13:33:48.362862+0000","last_became_peered":"2023-12-19T13:33:48.362862+0000","last_unstale":"2023-12-19T13:33:49.350040+0000","last_undegraded":"2023-12-19T13:33:49.350040+0000","last_fullsized":"2023-12-19T13:33:49.350040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:52.085776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772286+0000","last_change":"2023-12-19T13:33:47.991192+0000","last_active":"2023-12-19T13:33:50.772286+0000","last_peered":"2023-12-19T13:33:50.772286+0000","last_clean":"2023-12-19T13:33:50.772286+0000","last_became_active":"2023-12-19T13:33:47.990895+0000","last_became_peered":"2023-12-19T13:33:47.990895+0000","last_unstale":"2023-12-19T13:33:50.772286+0000","last_undegraded":"2023-12-19T13:33:50.772286+0000","last_fullsized":"2023-12-19T13:33:50.772286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:24:53.850954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.772115+0000","last_change":"2023-12-19T13:33:48.366038+0000","last_active":"2023-12-19T13:33:50.772115+0000","last_peered":"2023-12-19T13:33:50.772115+0000","last_clean":"2023-12-19T13:33:50.772115+0000","last_became_active":"2023-12-19T13:33:48.365590+0000","last_became_peered":"2023-12-19T13:33:48.365590+0000","last_unstale":"2023-12-19T13:33:50.772115+0000","last_undegraded":"2023-12-19T13:33:50.772115+0000","last_fullsized":"2023-12-19T13:33:50.772115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:25.234492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.348511+0000","last_change":"2023-12-19T13:33:47.988271+0000","last_active":"2023-12-19T13:33:49.348511+0000","last_peered":"2023-12-19T13:33:49.348511+0000","last_clean":"2023-12-19T13:33:49.348511+0000","last_became_active":"2023-12-19T13:33:47.986094+0000","last_became_peered":"2023-12-19T13:33:47.986094+0000","last_unstale":"2023-12-19T13:33:49.348511+0000","last_undegraded":"2023-12-19T13:33:49.348511+0000","last_fullsized":"2023-12-19T13:33:49.348511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:11.514415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.490976+0000","last_change":"2023-12-19T13:33:48.364568+0000","last_active":"2023-12-19T13:33:49.490976+0000","last_peered":"2023-12-19T13:33:49.490976+0000","last_clean":"2023-12-19T13:33:49.490976+0000","last_became_active":"2023-12-19T13:33:48.364341+0000","last_became_peered":"2023-12-19T13:33:48.364341+0000","last_unstale":"2023-12-19T13:33:49.490976+0000","last_undegraded":"2023-12-19T13:33:49.490976+0000","last_fullsized":"2023-12-19T13:33:49.490976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:12.067244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.350125+0000","last_change":"2023-12-19T13:33:47.980967+0000","last_active":"2023-12-19T13:33:49.350125+0000","last_peered":"2023-12-19T13:33:49.350125+0000","last_clean":"2023-12-19T13:33:49.350125+0000","last_became_active":"2023-12-19T13:33:47.980700+0000","last_became_peered":"2023-12-19T13:33:47.980700+0000","last_unstale":"2023-12-19T13:33:49.350125+0000","last_undegraded":"2023-12-19T13:33:49.350125+0000","last_fullsized":"2023-12-19T13:33:49.350125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:01.081990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349956+0000","last_change":"2023-12-19T13:33:48.366598+0000","last_active":"2023-12-19T13:33:49.349956+0000","last_peered":"2023-12-19T13:33:49.349956+0000","last_clean":"2023-12-19T13:33:49.349956+0000","last_became_active":"2023-12-19T13:33:48.366354+0000","last_became_peered":"2023-12-19T13:33:48.366354+0000","last_unstale":"2023-12-19T13:33:49.349956+0000","last_undegraded":"2023-12-19T13:33:49.349956+0000","last_fullsized":"2023-12-19T13:33:49.349956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:15.671470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.491089+0000","last_change":"2023-12-19T13:33:47.991316+0000","last_active":"2023-12-19T13:33:49.491089+0000","last_peered":"2023-12-19T13:33:49.491089+0000","last_clean":"2023-12-19T13:33:49.491089+0000","last_became_active":"2023-12-19T13:33:47.991009+0000","last_became_peered":"2023-12-19T13:33:47.991009+0000","last_unstale":"2023-12-19T13:33:49.491089+0000","last_undegraded":"2023-12-19T13:33:49.491089+0000","last_fullsized":"2023-12-19T13:33:49.491089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:56.757658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:50.236028+0000","last_change":"2023-12-19T13:33:48.361285+0000","last_active":"2023-12-19T13:33:50.236028+0000","last_peered":"2023-12-19T13:33:50.236028+0000","last_clean":"2023-12-19T13:33:50.236028+0000","last_became_active":"2023-12-19T13:33:48.361012+0000","last_became_peered":"2023-12-19T13:33:48.361012+0000","last_unstale":"2023-12-19T13:33:50.236028+0000","last_undegraded":"2023-12-19T13:33:50.236028+0000","last_fullsized":"2023-12-19T13:33:50.236028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:47.963997+0000","last_clean_scrub_stamp":"2023-12-19T13:33:47.963997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:48:25.234492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T13:33:49.349916+0000","last_change":"2023-12-19T13:33:47.979775+0000","last_active":"2023-12-19T13:33:49.349916+0000","last_peered":"2023-12-19T13:33:49.349916+0000","last_clean":"2023-12-19T13:33:49.349916+0000","last_became_active":"2023-12-19T13:33:47.979525+0000","last_became_peered":"2023-12-19T13:33:47.979525+0000","last_unstale":"2023-12-19T13:33:49.349916+0000","last_undegraded":"2023-12-19T13:33:49.349916+0000","last_fullsized":"2023-12-19T13:33:49.349916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:33:46.956678+0000","last_clean_scrub_stamp":"2023-12-19T13:33:46.956678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:08:01.322189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T13:33:48.353415+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T13:33:48.353415+0000","last_peered":"2023-12-19T13:33:48.353415+0000","last_clean":"2023-12-19T13:33:48.353415+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T13:33:48.353415+0000","last_undegraded":"2023-12-19T13:33:48.353415+0000","last_fullsized":"2023-12-19T13:33:48.353415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":718420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":128634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":335872,"data_stored":127013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.895}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0750000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.734}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":717311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T13:33:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T13:33:52.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T13:33:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.458+0000 7f61672c4640 1 Processor -- start 2023-12-19T13:33:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.459+0000 7f61672c4640 1 -- start start 2023-12-19T13:33:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.459+0000 7f61672c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f61600bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.459+0000 7f61672c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f61600b77c0 0x7f61601554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.459+0000 7f61672c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600b6f30 con 0x7f61600b81f0 2023-12-19T13:33:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.459+0000 7f61672c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61600b96a0 con 0x7f61600b77c0 2023-12-19T13:33:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.459+0000 7f61672c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600bc740 con 0x7f6160144ff0 2023-12-19T13:33:52.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f61600bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f61600bd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:57206/0 (socket says 172.21.15.6:57206) 2023-12-19T13:33:52.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165861640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f61600b77c0 0x7f61601554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 -- 172.21.15.6:0/3479462332 learned_addr learned my addr 172.21.15.6:0/3479462332 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 -- 172.21.15.6:0/3479462332 >> v2:172.21.15.89:3300/0 conn(0x7f61600b77c0 msgr2=0x7f61601554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 --2- 172.21.15.6:0/3479462332 >> v2:172.21.15.89:3300/0 conn(0x7f61600b77c0 0x7f61601554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 -- 172.21.15.6:0/3479462332 >> v1:172.21.15.89:6789/0 conn(0x7f61600b81f0 legacy=0x7f616014e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165060640 1 -- 172.21.15.6:0/3479462332 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600b8c50 con 0x7f6160144ff0 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.460+0000 7f6165861640 1 --2- 172.21.15.6:0/3479462332 >> v2:172.21.15.89:3300/0 conn(0x7f61600b77c0 0x7f61601554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f6165060640 1 --2- 172.21.15.6:0/3479462332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f61600bd1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f615c009870 tx=0x7f615c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d323d2985d34047 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f6157fff640 1 -- 172.21.15.6:0/3479462332 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c030840 con 0x7f6160144ff0 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f6157fff640 1 -- 172.21.15.6:0/3479462332 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c0309a0 con 0x7f6160144ff0 2023-12-19T13:33:52.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f6157fff640 1 -- 172.21.15.6:0/3479462332 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c030d30 con 0x7f6160144ff0 2023-12-19T13:33:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f61672c4640 1 -- 172.21.15.6:0/3479462332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 msgr2=0x7f61600bd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f61672c4640 1 --2- 172.21.15.6:0/3479462332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f61600bd1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f615c009870 tx=0x7f615c02b980 comp rx=0 tx=0).stop 2023-12-19T13:33:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f61672c4640 1 -- 172.21.15.6:0/3479462332 shutdown_connections 2023-12-19T13:33:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f61672c4640 1 --2- 172.21.15.6:0/3479462332 >> v2:172.21.15.89:3300/0 conn(0x7f61600b77c0 0x7f61601554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f61672c4640 1 --2- 172.21.15.6:0/3479462332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f61600bd1b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.461+0000 7f61672c4640 1 -- 172.21.15.6:0/3479462332 >> 172.21.15.6:0/3479462332 conn(0x7f6160071610 msgr2=0x7f61600719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.462+0000 7f61672c4640 1 -- 172.21.15.6:0/3479462332 shutdown_connections 2023-12-19T13:33:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.462+0000 7f61672c4640 1 -- 172.21.15.6:0/3479462332 wait complete. 2023-12-19T13:33:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.462+0000 7f61672c4640 1 Processor -- start 2023-12-19T13:33:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 -- start start 2023-12-19T13:33:52.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61600b77c0 0x7f616014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 0x7f616014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f616014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616014c5b0 con 0x7f61600b81f0 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616014cec0 con 0x7f61600b77c0 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f61672c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616014ee70 con 0x7f6160144ff0 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f616485f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 0x7f616014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f616485f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 0x7f616014d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53452/0 (socket says 172.21.15.6:53452) 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f616485f640 1 -- 172.21.15.6:0/4086038056 learned_addr learned my addr 172.21.15.6:0/4086038056 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f6165861640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f616014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.463+0000 7f6165060640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61600b77c0 0x7f616014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f616485f640 1 -- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 msgr2=0x7f616014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f616485f640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f616014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f616485f640 1 -- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61600b77c0 msgr2=0x7f616014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f616485f640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61600b77c0 0x7f616014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f616485f640 1 -- 172.21.15.6:0/4086038056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009a70 con 0x7f61600b81f0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f616485f640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 0x7f616014d800 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f615000c450 tx=0x7f615000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500052d0 con 0x7f61600b81f0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6150005430 con 0x7f61600b81f0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c0094d0 con 0x7f61600b81f0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150012870 con 0x7f61600b81f0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.464+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616014c2d0 con 0x7f61600b81f0 2023-12-19T13:33:52.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.465+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616014a840 con 0x7f61600b81f0 2023-12-19T13:33:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.465+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61500129d0 con 0x7f61600b81f0 2023-12-19T13:33:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.466+0000 7f6155ffb640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f614406a430 0x7f614406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.466+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61500880f0 con 0x7f61600b81f0 2023-12-19T13:33:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.466+0000 7f6165060640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f614406a430 0x7f614406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.467+0000 7f6165060640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f614406a430 0x7f614406c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f615c036000 tx=0x7f615c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.470+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f616014a840 con 0x7f61600b81f0 2023-12-19T13:33:52.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.709+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f61600b6f30 con 0x7f61600b81f0 2023-12-19T13:33:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.713+0000 7f6155ffb640 1 -- 172.21.15.6:0/4086038056 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f61600b6f30 con 0x7f61600b81f0 2023-12-19T13:33:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-12-19T13:33:52.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f614406a430 msgr2=0x7f614406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f614406a430 0x7f614406c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f615c036000 tx=0x7f615c008030 comp rx=0 tx=0).stop 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 msgr2=0x7f616014d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 0x7f616014d800 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f615000c450 tx=0x7f615000c910 comp rx=0 tx=0).stop 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 shutdown_connections 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f614406a430 0x7f614406c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6160144ff0 0x7f616014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61600b81f0 0x7f616014d800 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 --2- 172.21.15.6:0/4086038056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61600b77c0 0x7f616014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 >> 172.21.15.6:0/4086038056 conn(0x7f6160071610 msgr2=0x7f6160145e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 shutdown_connections 2023-12-19T13:33:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.715+0000 7f61672c4640 1 -- 172.21.15.6:0/4086038056 wait complete. 2023-12-19T13:33:52.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T13:33:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.831+0000 7f7c98f18640 1 Processor -- start 2023-12-19T13:33:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.831+0000 7f7c98f18640 1 -- start start 2023-12-19T13:33:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.831+0000 7f7c98f18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c940b2ed0 0x7f7c94070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.831+0000 7f7c98f18640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c94071c80 con 0x7f7c9406a390 2023-12-19T13:33:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.831+0000 7f7c98f18640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940715e0 con 0x7f7c94141680 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.831+0000 7f7c98f18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941487f0 con 0x7f7c940b2ed0 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c9406a390 0x7f7c941480e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40994/0 (socket says 172.21.15.6:40994) 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9259c640 1 -- 172.21.15.6:0/1675735120 learned_addr learned my addr 172.21.15.6:0/1675735120 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605439414 0 0) 0x7f7c94071c80 con 0x7f7c9406a390 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c91d9b640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c940b2ed0 0x7f7c94070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003520 con 0x7f7c9406a390 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3740224561 0 0) 0x7f7c7c003520 con 0x7f7c9406a390 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c940b2ed0 msgr2=0x7f7c94070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c940b2ed0 0x7f7c94070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 >> v1:172.21.15.89:6789/0 conn(0x7f7c94141680 legacy=0x7f7c94152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940718c0 con 0x7f7c9406a390 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f7c84001670 con 0x7f7c9406a390 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 >> v1:172.21.15.6:6789/0 conn(0x7f7c9406a390 legacy=0x7f7c941480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c7c0039a0 0x7f7c7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c7c0047c0 0x7f7c7c004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c005140 0x7f7c7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941487f0 con 0x7f7c7c0039a0 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c00bec0 con 0x7f7c7c005140 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c00c000 con 0x7f7c7c0047c0 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c9259c640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c7c0039a0 0x7f7c7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c91d9b640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c7c0047c0 0x7f7c7c004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.832+0000 7f7c92d9d640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c005140 0x7f7c7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9259c640 1 -- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c7c0047c0 msgr2=0x7f7c7c004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9259c640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c7c0047c0 0x7f7c7c004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9259c640 1 -- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c005140 msgr2=0x7f7c7c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9259c640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c005140 0x7f7c7c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9259c640 1 -- 172.21.15.6:0/1675735120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c003520 con 0x7f7c7c0039a0 2023-12-19T13:33:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9259c640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c7c0039a0 0x7f7c7c003dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400c190 tx=0x7f7c7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3451124b9bcca549 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.833+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84005ad0 con 0x7f7c7c0039a0 2023-12-19T13:33:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84005c30 con 0x7f7c7c0039a0 2023-12-19T13:33:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c9159a640 1 -- 172.21.15.6:0/1675735120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8402c8a0 con 0x7f7c7c0039a0 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c98f18640 1 -- 172.21.15.6:0/1675735120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c7c0039a0 msgr2=0x7f7c7c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c98f18640 1 --2- 172.21.15.6:0/1675735120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c7c0039a0 0x7f7c7c003dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400c190 tx=0x7f7c7c0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c92d9d640 1 -- 172.21.15.6:0/1675735120 reap_dead start 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c98f18640 1 -- 172.21.15.6:0/1675735120 shutdown_connections 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c98f18640 1 -- 172.21.15.6:0/1675735120 >> 172.21.15.6:0/1675735120 conn(0x7f7c940bc330 msgr2=0x7f7c940bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c98f18640 1 -- 172.21.15.6:0/1675735120 shutdown_connections 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.834+0000 7f7c98f18640 1 -- 172.21.15.6:0/1675735120 wait complete. 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.835+0000 7f7c98f18640 1 Processor -- start 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.835+0000 7f7c98f18640 1 -- start start 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c98f18640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c0039a0 0x7f7c941cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c98f18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c941d29b0 0x7f7c941e0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c98f18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 0x7f7c9413c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c98f18640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941d01f0 con 0x7f7c941e09b0 2023-12-19T13:33:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c98f18640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941e0e60 con 0x7f7c7c0039a0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c98f18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94146670 con 0x7f7c941d29b0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 0x7f7c9413c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 0x7f7c9413c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53468/0 (socket says 172.21.15.6:53468) 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 -- 172.21.15.6:0/4186463809 learned_addr learned my addr 172.21.15.6:0/4186463809 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c9259c640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c0039a0 0x7f7c941cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c91d9b640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c941d29b0 0x7f7c941e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 -- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c941d29b0 msgr2=0x7f7c941e0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c941d29b0 0x7f7c941e0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 -- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c0039a0 msgr2=0x7f7c941cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c0039a0 0x7f7c941cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.836+0000 7f7c92d9d640 1 -- 172.21.15.6:0/4186463809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94146910 con 0x7f7c941e09b0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.837+0000 7f7c92d9d640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 0x7f7c9413c1e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b3b00 tx=0x7f7c8c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.837+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00fed0 con 0x7f7c941e09b0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.837+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c006d60 con 0x7f7c941e09b0 2023-12-19T13:33:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.837+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c94146bf0 con 0x7f7c941e09b0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.837+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c003b90 con 0x7f7c941e09b0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.837+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c94147640 con 0x7f7c941e09b0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.838+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c94147110 con 0x7f7c941e09b0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.838+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c8c003cf0 con 0x7f7c941e09b0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.838+0000 7f7c82ffd640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7c7406a460 0x7f7c7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.839+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c8c087f20 con 0x7f7c941e09b0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.839+0000 7f7c9259c640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7c7406a460 0x7f7c7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.839+0000 7f7c9259c640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7c7406a460 0x7f7c7406c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034000 tx=0x7f7c84009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:52.843+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c94147110 con 0x7f7c941e09b0 2023-12-19T13:33:53.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.055+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c94073a40 con 0x7f7c941e09b0 2023-12-19T13:33:53.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.055+0000 7f7c82ffd640 1 -- 172.21.15.6:0/4186463809 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3882 (secure 0 0 0) 0x7f7c8c0535c0 con 0x7f7c941e09b0 2023-12-19T13:33:53.057 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:33:53.057 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:48.343293+0000","modified":"2023-12-19T13:33:50.971099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/331533137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":331533137},{"type":"v1","addr":"172.21.15.6:6835","nonce":331533137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T13:33:53.058 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2023-12-19T13:33:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7c7406a460 msgr2=0x7f7c7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7c7406a460 0x7f7c7406c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034000 tx=0x7f7c84009030 comp rx=0 tx=0).stop 2023-12-19T13:33:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 msgr2=0x7f7c9413c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 0x7f7c9413c1e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b3b00 tx=0x7f7c8c00fc80 comp rx=0 tx=0).stop 2023-12-19T13:33:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 shutdown_connections 2023-12-19T13:33:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f7c7406a460 0x7f7c7406c920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c941e09b0 0x7f7c9413c1e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c941d29b0 0x7f7c941e0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 --2- 172.21.15.6:0/4186463809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c7c0039a0 0x7f7c941cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 >> 172.21.15.6:0/4186463809 conn(0x7f7c940bc330 msgr2=0x7f7c9406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 shutdown_connections 2023-12-19T13:33:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.057+0000 7f7c98f18640 1 -- 172.21.15.6:0/4186463809 wait complete. 2023-12-19T13:33:53.374 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T13:33:48.343293+0000', 'modified': '2023-12-19T13:33:50.971099+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/331533137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 331533137}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 331533137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T13:33:53.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T13:33:53.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T13:33:53.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.480+0000 7fa616296640 1 Processor -- start 2023-12-19T13:33:53.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa616296640 1 -- start start 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa616296640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 0x7fa610145b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa616296640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6100bb990 con 0x7fa6100bb1e0 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa616296640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6100ba5b0 con 0x7fa6100bbe60 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa616296640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100b8130 con 0x7fa6100bad90 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa614833640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa6100bb1e0 0x7fa610153270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41002/0 (socket says 172.21.15.6:41002) 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.481+0000 7fa614833640 1 -- 172.21.15.6:0/1962026819 learned_addr learned my addr 172.21.15.6:0/1962026819 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 0x7fa610145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402833567 0 0) 0x7fa6100bb990 con 0x7fa6100bb1e0 2023-12-19T13:33:53.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5fc003520 con 0x7fa6100bb1e0 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559491335 0 0) 0x7fa5fc003520 con 0x7fa6100bb1e0 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 msgr2=0x7fa610145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 0x7fa610145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 >> v1:172.21.15.89:6789/0 conn(0x7fa6100bbe60 legacy=0x7fa6100b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61009bd10 con 0x7fa6100bb1e0 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fa6080019f0 con 0x7fa6100bb1e0 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 >> v1:172.21.15.6:6789/0 conn(0x7fa6100bb1e0 legacy=0x7fa610153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 0x7fa5fc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5fc003f20 0x7fa5fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc004d00 0x7fa5fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100b8130 con 0x7fa5fc003f20 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc00baf0 con 0x7fa5fc004d00 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc00bcb0 con 0x7fa6100bad90 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5fc003f20 0x7fa5fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa614833640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc004d00 0x7fa5fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60ffff640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 0x7fa5fc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 -- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 msgr2=0x7fa5fc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6100bad90 0x7fa5fc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 -- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc004d00 msgr2=0x7fa5fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc004d00 0x7fa5fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.482+0000 7fa60f7fe640 1 -- 172.21.15.6:0/1962026819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc003520 con 0x7fa5fc003f20 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.483+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5fc003f20 0x7fa5fc0047c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009ac0 tx=0x7fa5fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4906faf9ae738a20 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.483+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f802c6b0 con 0x7fa5fc003f20 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.483+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f802c810 con 0x7fa5fc003f20 2023-12-19T13:33:53.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.483+0000 7fa60effd640 1 -- 172.21.15.6:0/1962026819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f802cba0 con 0x7fa5fc003f20 2023-12-19T13:33:53.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa616296640 1 -- 172.21.15.6:0/1962026819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5fc003f20 msgr2=0x7fa5fc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa616296640 1 --2- 172.21.15.6:0/1962026819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5fc003f20 0x7fa5fc0047c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009ac0 tx=0x7fa5fc0057f0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa614833640 1 -- 172.21.15.6:0/1962026819 reap_dead start 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa616296640 1 -- 172.21.15.6:0/1962026819 shutdown_connections 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa616296640 1 -- 172.21.15.6:0/1962026819 >> 172.21.15.6:0/1962026819 conn(0x7fa6100b9250 msgr2=0x7fa6100b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa616296640 1 -- 172.21.15.6:0/1962026819 shutdown_connections 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.484+0000 7fa616296640 1 -- 172.21.15.6:0/1962026819 wait complete. 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.485+0000 7fa616296640 1 Processor -- start 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.485+0000 7fa616296640 1 -- start start 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc003f20 0x7fa6100707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610099f70 0x7fa61013eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 0x7fa610149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610070ce0 con 0x7fa61013f0e0 2023-12-19T13:33:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61014caf0 con 0x7fa610099f70 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61014c530 con 0x7fa5fc003f20 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 0x7fa610149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 0x7fa610149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53482/0 (socket says 172.21.15.6:53482) 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 -- 172.21.15.6:0/841193633 learned_addr learned my addr 172.21.15.6:0/841193633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa60ffff640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc003f20 0x7fa6100707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610099f70 0x7fa61013eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 -- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc003f20 msgr2=0x7fa6100707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc003f20 0x7fa6100707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 -- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610099f70 msgr2=0x7fa61013eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610099f70 0x7fa61013eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 -- 172.21.15.6:0/841193633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61014bc00 con 0x7fa61013f0e0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa60ffff640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc003f20 0x7fa6100707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa614833640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 0x7fa610149c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa6100bc730 tx=0x7fa60800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa60cff9640 1 -- 172.21.15.6:0/841193633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800ace0 con 0x7fa61013f0e0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa60cff9640 1 -- 172.21.15.6:0/841193633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800ae40 con 0x7fa61013f0e0 2023-12-19T13:33:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61014bee0 con 0x7fa61013f0e0 2023-12-19T13:33:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa60cff9640 1 -- 172.21.15.6:0/841193633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608013630 con 0x7fa61013f0e0 2023-12-19T13:33:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.486+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61009a3d0 con 0x7fa61013f0e0 2023-12-19T13:33:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.488+0000 7fa60cff9640 1 -- 172.21.15.6:0/841193633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa608013790 con 0x7fa61013f0e0 2023-12-19T13:33:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.488+0000 7fa60cff9640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa5f006a430 0x7fa5f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.488+0000 7fa60cff9640 1 -- 172.21.15.6:0/841193633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa608089160 con 0x7fa61013f0e0 2023-12-19T13:33:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.488+0000 7fa60ffff640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa5f006a430 0x7fa5f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.489+0000 7fa60ffff640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa5f006a430 0x7fa5f006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6000035f0 tx=0x7fa600009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.489+0000 7fa618e08740 1 Processor -- start 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.489+0000 7fa618e08740 1 -- start start 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa618e08740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f068a8a0 0x55a8f06bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa618e08740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f05fa030 con 0x55a8f06c6420 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f05f77c0 con 0x55a8f06bbc20 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f05f30b0 con 0x55a8f068a8a0 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53498/0 (socket says 172.21.15.6:53498) 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 -- 172.21.15.6:0/1513153411 learned_addr learned my addr 172.21.15.6:0/1513153411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f068a8a0 0x55a8f06bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa614833640 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 -- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f068a8a0 msgr2=0x55a8f06bb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f068a8a0 0x55a8f06bb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 -- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 msgr2=0x55a8f06cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 -- 172.21.15.6:0/1513153411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f05adbc0 con 0x55a8f06c6420 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f068a8a0 0x55a8f06bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa60ffff640 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068a360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa600001790 tx=0x7fa600013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359638c95c7c4103 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa605ffb640 1 -- 172.21.15.6:0/1513153411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600014980 con 0x55a8f06c6420 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa605ffb640 1 -- 172.21.15.6:0/1513153411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600014ae0 con 0x55a8f06c6420 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.490+0000 7fa605ffb640 1 -- 172.21.15.6:0/1513153411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600014e50 con 0x55a8f06c6420 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 -- 172.21.15.6:0/1513153411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 msgr2=0x55a8f068a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068a360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa600001790 tx=0x7fa600013000 comp rx=0 tx=0).stop 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 -- 172.21.15.6:0/1513153411 shutdown_connections 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f068a8a0 0x55a8f06bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 --2- 172.21.15.6:0/1513153411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068a360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 -- 172.21.15.6:0/1513153411 >> 172.21.15.6:0/1513153411 conn(0x55a8f068bf80 msgr2=0x55a8f06c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 -- 172.21.15.6:0/1513153411 shutdown_connections 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 -- 172.21.15.6:0/1513153411 wait complete. 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.491+0000 7fa618e08740 1 -- start start 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 Processor -- start 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 0x55a8f06be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bf6b0 0x55a8f06b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f05b17c0 con 0x55a8f06bbc20 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f05b1460 con 0x55a8f06bf6b0 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f05771b0 con 0x55a8f06c6420 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa60ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 0x55a8f06be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.492+0000 7fa618e08740 10 client.0 _ll_register_callbacks cb 0x55a8f057a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:33:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 0x55a8f06be6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53508/0 (socket says 172.21.15.6:53508) 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 -- 172.21.15.6:0/199963621 learned_addr learned my addr 172.21.15.6:0/199963621 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa614833640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bf6b0 0x55a8f06b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 -- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 msgr2=0x55a8f06cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 -- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bf6b0 msgr2=0x55a8f06b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bf6b0 0x55a8f06b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 -- 172.21.15.6:0/199963621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60000f040 con 0x55a8f06bbc20 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa60ffff640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 0x55a8f06be6a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6000147d0 tx=0x7fa600001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90338a3e0ea60f61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa5eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa5eeffd640 1 -- 172.21.15.6:0/199963621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600021930 con 0x55a8f06bbc20 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa5eeffd640 1 -- 172.21.15.6:0/199963621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa60001c050 con 0x55a8f06bbc20 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8f05e49e0 con 0x55a8f06bbc20 2023-12-19T13:33:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa5eeffd640 1 -- 172.21.15.6:0/199963621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa600021a90 con 0x55a8f06bbc20 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa618e08740 10 client.5097 fetch_fsmap learned FSMap version 14 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55a8f05f1730 con 0x55a8f06bbc20 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa5eeffd640 1 -- 172.21.15.6:0/199963621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8f05e49e0 con 0x55a8f06bbc20 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.493+0000 7fa5eeffd640 1 -- 172.21.15.6:0/199963621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 14) v1 ==== 2561+0+0 (secure 0 0 0) 0x7fa600021bf0 con 0x55a8f06bbc20 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa618e08740 10 client.5097 fetch_fsmap finished waiting for FSMap version 14 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa618e08740 10 client.5097 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa618e08740 20 client.5097 populate_metadata read hostname 'smithi006' 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa618e08740 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f06d9e10 0x55a8f06da1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa618e08740 4 client.5097 mds_command: new command op to 4920 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 --> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8f05ec130 con 0x55a8f06d9e10 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f06d9e10 0x55a8f06da1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa5eeffd640 10 client.5097 ms_handle_connect on v2:172.21.15.6:6834/331533137 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f06d9e10 0x55a8f06da1f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888240001c68d791 server_cookie=2bf9b0257b5190c in_seq=0 out_seq=0 2023-12-19T13:33:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa5eeffd640 1 -- 172.21.15.6:0/199963621 <== mds.0 v2:172.21.15.6:6834/331533137 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55a8f05ec130 con 0x55a8f06d9e10 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.494+0000 7fa5eeffd640 10 client.5097 handle_command_reply: tid=0 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 client.5097 shutdown 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 msgr2=0x55a8f06be6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 0x55a8f06be6a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6000147d0 tx=0x7fa600001120 comp rx=0 tx=0).stop 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 shutdown_connections 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f06d9e10 0x55a8f06da1f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bf6b0 0x55a8f06b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa5eeffd640 0 client.5097 ms_handle_reset on v2:172.21.15.6:6834/331533137 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 --2- 172.21.15.6:0/199963621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bbc20 0x55a8f06be6a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 >> 172.21.15.6:0/199963621 conn(0x55a8f068a8a0 msgr2=0x55a8f0688d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 shutdown_connections 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 1 -- 172.21.15.6:0/199963621 wait complete. 2023-12-19T13:33:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.495+0000 7fa618e08740 20 client.5097 trim_cache size 0 max 16384 2023-12-19T13:33:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.510+0000 7fa618e08740 1 Processor -- start 2023-12-19T13:33:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.510+0000 7fa618e08740 1 -- start start 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa618e08740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 0x55a8f06d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06d9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa618e08740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f068d150 con 0x55a8f06bf6b0 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f06c5f30 con 0x55a8f06bbc20 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f06be6f0 con 0x55a8f06c6420 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 0x55a8f06d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 0x55a8f06d8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53522/0 (socket says 172.21.15.6:53522) 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 -- 172.21.15.6:0/3162261196 learned_addr learned my addr 172.21.15.6:0/3162261196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 -- 172.21.15.6:0/3162261196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 msgr2=0x55a8f06d9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06d9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 -- 172.21.15.6:0/3162261196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 msgr2=0x55a8f06ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 -- 172.21.15.6:0/3162261196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6100998b0 con 0x55a8f06bf6b0 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 0x55a8f06d8e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009be0 tx=0x7fa5f8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903dcb2650d3cc21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa6067fc640 1 -- 172.21.15.6:0/3162261196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80042c0 con 0x55a8f06bf6b0 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa6067fc640 1 -- 172.21.15.6:0/3162261196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f8004440 con 0x55a8f06bf6b0 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.511+0000 7fa6067fc640 1 -- 172.21.15.6:0/3162261196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f802cbc0 con 0x55a8f06bf6b0 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 -- 172.21.15.6:0/3162261196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 msgr2=0x55a8f06d8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 0x55a8f06d8e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009be0 tx=0x7fa5f8030000 comp rx=0 tx=0).stop 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 -- 172.21.15.6:0/3162261196 shutdown_connections 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06c6420 0x55a8f06d9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06bf6b0 0x55a8f06d8e10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 --2- 172.21.15.6:0/3162261196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 -- 172.21.15.6:0/3162261196 >> 172.21.15.6:0/3162261196 conn(0x55a8f068a8a0 msgr2=0x55a8f06b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 -- 172.21.15.6:0/3162261196 shutdown_connections 2023-12-19T13:33:53.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 -- 172.21.15.6:0/3162261196 wait complete. 2023-12-19T13:33:53.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.512+0000 7fa618e08740 1 -- start start 2023-12-19T13:33:53.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 Processor -- start 2023-12-19T13:33:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06bf6b0 0x55a8f06aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f06cf5f0 con 0x55a8f06c6420 2023-12-19T13:33:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f06af920 con 0x55a8f06bbc20 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f06ccfc0 con 0x55a8f06bf6b0 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa618e08740 10 client.0 _ll_register_callbacks cb 0x7fa600005300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa614833640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa614833640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53528/0 (socket says 172.21.15.6:53528) 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa614833640 1 -- 172.21.15.6:0/3819827875 learned_addr learned my addr 172.21.15.6:0/3819827875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa60f7fe640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06bf6b0 0x55a8f06aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.513+0000 7fa60ffff640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa614833640 1 -- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06bf6b0 msgr2=0x55a8f06aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa614833640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06bf6b0 0x55a8f06aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa614833640 1 -- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 msgr2=0x55a8f06cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa614833640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa614833640 1 -- 172.21.15.6:0/3819827875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc003520 con 0x55a8f06c6420 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa60ffff640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa614833640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068daa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa60800a2e0 tx=0x7fa608058b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167e143584c990b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa5eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa5eeffd640 1 -- 172.21.15.6:0/3819827875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6080587d0 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa5eeffd640 1 -- 172.21.15.6:0/3819827875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa608060350 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa600014ae0 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa5eeffd640 1 -- 172.21.15.6:0/3819827875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa608087260 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 10 client.5103 fetch_fsmap learned FSMap version 14 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55a8f0593b60 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa5eeffd640 1 -- 172.21.15.6:0/3819827875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa608074020 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa5eeffd640 1 -- 172.21.15.6:0/3819827875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 14) v1 ==== 2561+0+0 (secure 0 0 0) 0x7fa608012070 con 0x55a8f06c6420 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 10 client.5103 fetch_fsmap finished waiting for FSMap version 14 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 10 client.5103 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 20 client.5103 populate_metadata read hostname 'smithi006' 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f068e5d0 0x55a8f0729f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 4 client.5103 mds_command: new command op to 4920 tid=0[{"prefix": "status"}] 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 --> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a8f05ebe50 con 0x55a8f068e5d0 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.514+0000 7fa60ffff640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f068e5d0 0x55a8f0729f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa5eeffd640 10 client.5103 ms_handle_connect on v2:172.21.15.6:6834/331533137 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa60ffff640 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f068e5d0 0x55a8f0729f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee5c47999f540581 server_cookie=b40cdc632081237e in_seq=0 out_seq=0 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa5eeffd640 1 -- 172.21.15.6:0/3819827875 <== mds.0 v2:172.21.15.6:6834/331533137 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55a8f05ebe50 con 0x55a8f068e5d0 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa5eeffd640 10 client.5103 handle_command_reply: tid=0 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 client.5103 shutdown 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 msgr2=0x55a8f068daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068daa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa60800a2e0 tx=0x7fa608058b30 comp rx=0 tx=0).stop 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 shutdown_connections 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:6834/331533137,v1:172.21.15.6:6835/331533137] conn(0x55a8f068e5d0 0x55a8f0729f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8f06c6420 0x55a8f068daa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a8f06bf6b0 0x55a8f06aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa5eeffd640 0 client.5103 ms_handle_reset on v2:172.21.15.6:6834/331533137 2023-12-19T13:33:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 --2- 172.21.15.6:0/3819827875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8f06bbc20 0x55a8f06cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 >> 172.21.15.6:0/3819827875 conn(0x55a8f068a8a0 msgr2=0x55a8f06ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 shutdown_connections 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 1 -- 172.21.15.6:0/3819827875 wait complete. 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.515+0000 7fa618e08740 20 client.5103 trim_cache size 0 max 16384 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "dcbd1077-757f-4b91-a6c2-c01c60d71a4f", 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4920, 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-12-19T13:33:53.523 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-12-19T13:33:53.524 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.1712974190000001, 2023-12-19T13:33:53.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 14, 2023-12-19T13:33:53.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 31, 2023-12-19T13:33:53.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 31, 2023-12-19T13:33:53.524 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 12.411822489 2023-12-19T13:33:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa5f006a430 msgr2=0x7fa5f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa5f006a430 0x7fa5f006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6000035f0 tx=0x7fa600009040 comp rx=0 tx=0).stop 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 msgr2=0x7fa610149c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 0x7fa610149c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa6100bc730 tx=0x7fa60800a6e0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 shutdown_connections 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fa5f006a430 0x7fa5f006c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa61013f0e0 0x7fa610149c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610099f70 0x7fa61013eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 --2- 172.21.15.6:0/841193633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc003f20 0x7fa6100707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 >> 172.21.15.6:0/841193633 conn(0x7fa6100b9250 msgr2=0x7fa61006be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 shutdown_connections 2023-12-19T13:33:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.516+0000 7fa616296640 1 -- 172.21.15.6:0/841193633 wait complete. 2023-12-19T13:33:53.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T13:33:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 Processor -- start 2023-12-19T13:33:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 -- start start 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63a806a6d0 0x7f63a814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63a814b1f0 0x7f63a80b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a80bb310 con 0x7f63a80ba550 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80bf960 con 0x7f63a814b1f0 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63adc77640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80bb5b0 con 0x7f63a806a6d0 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63a6ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63a814b1f0 0x7f63a80b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63a7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63a80ba550 0x7f63a814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41012/0 (socket says 172.21.15.6:41012) 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63a6ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63a814b1f0 0x7f63a80b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53538/0 (socket says 172.21.15.6:53538) 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.633+0000 7f63a7fff640 1 -- 172.21.15.6:0/4139556454 learned_addr learned my addr 172.21.15.6:0/4139556454 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a77fe640 1 --2- 172.21.15.6:0/4139556454 >> v2:172.21.15.89:3300/0 conn(0x7f63a806a6d0 0x7f63a814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a6ffd640 1 -- 172.21.15.6:0/4139556454 >> v2:172.21.15.89:3300/0 conn(0x7f63a806a6d0 msgr2=0x7f63a814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a6ffd640 1 --2- 172.21.15.6:0/4139556454 >> v2:172.21.15.89:3300/0 conn(0x7f63a806a6d0 0x7f63a814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a6ffd640 1 -- 172.21.15.6:0/4139556454 >> v1:172.21.15.6:6789/0 conn(0x7f63a80ba550 legacy=0x7f63a814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a6ffd640 1 -- 172.21.15.6:0/4139556454 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80c0120 con 0x7f63a814b1f0 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a67fc640 1 -- 172.21.15.6:0/4139556454 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210142861 0 0) 0x7f63a80bb310 con 0x7f63a80ba550 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.634+0000 7f63a6ffd640 1 --2- 172.21.15.6:0/4139556454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a814b1f0 0x7f63a80b9ac0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63a808a260 tx=0x7f639c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99bf3f454ed1bb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63a67fc640 1 -- 172.21.15.6:0/4139556454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c031830 con 0x7f63a814b1f0 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63a67fc640 1 -- 172.21.15.6:0/4139556454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c031990 con 0x7f63a814b1f0 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63a67fc640 1 -- 172.21.15.6:0/4139556454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c031d20 con 0x7f63a814b1f0 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 -- 172.21.15.6:0/4139556454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a814b1f0 msgr2=0x7f63a80b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 --2- 172.21.15.6:0/4139556454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a814b1f0 0x7f63a80b9ac0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63a808a260 tx=0x7f639c02b8d0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 -- 172.21.15.6:0/4139556454 shutdown_connections 2023-12-19T13:33:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 --2- 172.21.15.6:0/4139556454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a814b1f0 0x7f63a80b9ac0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 --2- 172.21.15.6:0/4139556454 >> v2:172.21.15.89:3300/0 conn(0x7f63a806a6d0 0x7f63a814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 -- 172.21.15.6:0/4139556454 >> 172.21.15.6:0/4139556454 conn(0x7f63a80c0350 msgr2=0x7f63a80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 -- 172.21.15.6:0/4139556454 shutdown_connections 2023-12-19T13:33:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.635+0000 7f63adc77640 1 -- 172.21.15.6:0/4139556454 wait complete. 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.636+0000 7f63adc77640 1 Processor -- start 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.636+0000 7f63adc77640 1 -- start start 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63adc77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 0x7f63a80a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63adc77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a80ba550 0x7f63a8146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63adc77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a814b1f0 0x7f63a814e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63adc77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8146a90 con 0x7f63a806a6d0 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63adc77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80a4f40 con 0x7f63a814b1f0 2023-12-19T13:33:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63adc77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80a5220 con 0x7f63a80ba550 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 0x7f63a80a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 0x7f63a80a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53550/0 (socket says 172.21.15.6:53550) 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 -- 172.21.15.6:0/170755212 learned_addr learned my addr 172.21.15.6:0/170755212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a6ffd640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a80ba550 0x7f63a8146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a7fff640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a814b1f0 0x7f63a814e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 -- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a80ba550 msgr2=0x7f63a8146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a80ba550 0x7f63a8146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 -- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a814b1f0 msgr2=0x7f63a814e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a814b1f0 0x7f63a814e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a77fe640 1 -- 172.21.15.6:0/170755212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c009400 con 0x7f63a806a6d0 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a6ffd640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a80ba550 0x7f63a8146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.637+0000 7f63a7fff640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a814b1f0 0x7f63a814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.638+0000 7f63a77fe640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 0x7f63a80a5d00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f639800e9b0 tx=0x7f639800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.638+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398009670 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.638+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639800c9a0 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.638+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800cd50 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.638+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a80a5500 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.638+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a814ef20 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.639+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a8073a40 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.639+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6398013470 con 0x7f63a806a6d0 2023-12-19T13:33:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.640+0000 7f638ffff640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f639406a430 0x7f639406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:33:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.640+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6398088cd0 con 0x7f63a806a6d0 2023-12-19T13:33:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.640+0000 7f63a6ffd640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f639406a430 0x7f639406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:33:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.641+0000 7f63a6ffd640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f639406a430 0x7f639406c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f639c036000 tx=0x7f639c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:33:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.644+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6398054190 con 0x7f63a806a6d0 2023-12-19T13:33:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.860+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63a814ae50 con 0x7f63a806a6d0 2023-12-19T13:33:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.860+0000 7f638ffff640 1 -- 172.21.15.6:0/170755212 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6398021070 con 0x7f63a806a6d0 2023-12-19T13:33:53.862 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T13:33:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f639406a430 msgr2=0x7f639406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f639406a430 0x7f639406c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f639c036000 tx=0x7f639c008030 comp rx=0 tx=0).stop 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 msgr2=0x7f63a80a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 0x7f63a80a5d00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f639800e9b0 tx=0x7f639800ee70 comp rx=0 tx=0).stop 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 shutdown_connections 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f639406a430 0x7f639406c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a814b1f0 0x7f63a814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63a80ba550 0x7f63a8146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 --2- 172.21.15.6:0/170755212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63a806a6d0 0x7f63a80a5d00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.862+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 >> 172.21.15.6:0/170755212 conn(0x7f63a80c0350 msgr2=0x7f63a8146da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.863+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 shutdown_connections 2023-12-19T13:33:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:33:53.863+0000 7f63adc77640 1 -- 172.21.15.6:0/170755212 wait complete. 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T13:33:53.875 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:33:53.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:53.876 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-12-19T13:33:53.936 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:29:21:7b:97:ac brd ff:ff:ff:ff:ff:ff 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T13:33:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a8b9:96ff:fe4e:ceb5/64 scope link 2023-12-19T13:33:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:53.938 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T13:33:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 32:29:21:7b:97:ac brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T13:33:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::3029:21ff:fe7b:97ac/64 scope link 2023-12-19T13:33:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-12-19T13:33:53.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:53.939 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T13:33:54.030 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-12-19T13:33:54.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.034 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-12-19T13:33:54.085 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-12-19T13:33:54.085 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T13:33:54.085 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T13:33:54.085 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T13:33:54.085 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T13:33:54.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.086 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-12-19T13:33:54.087 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-12-19T13:33:54.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T13:33:54.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T13:33:54.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T13:33:54.087 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-12-19T13:33:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.267 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-12-19T13:33:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T13:33:54.319 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:33:54.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-12-19T13:33:54.414 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:33:54.426 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:54.482 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T13:33:54.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T13:33:54.483 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:54.533 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T13:33:54.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.533 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:54.671 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:54.671 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T13:33:54.671 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-12-19T13:33:54.692 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:54.692 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T13:33:54.692 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-12-19T13:33:54.692 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-19T13:33:54.692 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T13:33:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T13:33:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T13:33:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-12-19T13:33:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-19T13:33:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T13:33:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-12-19T13:33:54.717 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-12-19T13:33:54.717 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=dcbd1077-757f-4b91-a6c2-c01c60d71a4f" will pass to kernel 2023-12-19T13:33:54.719 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T13:33:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2023-12-19T13:33:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T13:33:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T13:33:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T13:33:54.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T13:33:54.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T13:33:54.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.803 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T13:33:54.864 INFO:teuthology.orchestra.run.smithi144.stdout:client4772 2023-12-19T13:33:54.865 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:33:54.865 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T13:33:54.918 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=xfstests-dev 2023-12-19T13:33:54.966 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.nnuPRzScSZxfstests-dev 2023-12-19T13:33:54.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:54.967 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.nnuPRzScSZxfstests-dev) 2023-12-19T13:33:55.021 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/tmp/tmp.nnuPRzScSZxfstests-dev'... 2023-12-19T13:33:56.065 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=xfsprogs-dev 2023-12-19T13:33:56.118 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.QMOkoB2Hnrxfsprogs-dev 2023-12-19T13:33:56.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:56.118 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.QMOkoB2Hnrxfsprogs-dev) 2023-12-19T13:33:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/tmp/tmp.QMOkoB2Hnrxfsprogs-dev'... 2023-12-19T13:33:56.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:56.813 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-19T13:33:56.875 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=test 2023-12-19T13:33:56.927 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.2JNDlqAT3Etest 2023-12-19T13:33:56.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T13:33:56.927 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-19T13:33:56.984 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=scratch 2023-12-19T13:33:57.034 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.Ca1ESYblXHscratch 2023-12-19T13:33:57.034 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-19T13:33:57.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-12-19T13:33:57.857 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:03:27 ago on Tue 19 Dec 2023 01:30:30 PM UTC. 2023-12-19T13:33:57.955 INFO:teuthology.orchestra.run.smithi144.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-19T13:33:57.956 INFO:teuthology.orchestra.run.smithi144.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:33:57.957 INFO:teuthology.orchestra.run.smithi144.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-19T13:33:57.958 INFO:teuthology.orchestra.run.smithi144.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-19T13:33:57.959 INFO:teuthology.orchestra.run.smithi144.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-19T13:33:57.961 INFO:teuthology.orchestra.run.smithi144.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-19T13:33:57.963 INFO:teuthology.orchestra.run.smithi144.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-19T13:33:57.964 INFO:teuthology.orchestra.run.smithi144.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-19T13:33:57.966 INFO:teuthology.orchestra.run.smithi144.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-19T13:33:57.967 INFO:teuthology.orchestra.run.smithi144.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-19T13:33:57.968 INFO:teuthology.orchestra.run.smithi144.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-19T13:33:57.969 INFO:teuthology.orchestra.run.smithi144.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-19T13:33:57.971 INFO:teuthology.orchestra.run.smithi144.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-19T13:33:57.971 INFO:teuthology.orchestra.run.smithi144.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-19T13:33:57.972 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-12-19T13:33:57.973 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:33:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-19T13:33:57.975 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T13:33:57.976 INFO:teuthology.orchestra.run.smithi144.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-19T13:33:57.977 INFO:teuthology.orchestra.run.smithi144.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T13:33:57.979 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:33:57.980 INFO:teuthology.orchestra.run.smithi144.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-19T13:33:57.984 INFO:teuthology.orchestra.run.smithi144.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2023-12-19T13:33:57.991 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T13:33:58.051 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-12-19T13:33:58.055 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-12-19T13:33:58.055 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-12-19T13:33:58.055 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-12-19T13:33:58.055 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-12-19T13:33:58.055 INFO:teuthology.orchestra.run.smithi144.stdout: device-mapper-devel x86_64 9:1.02.195-3.el9 crb 43 k 2023-12-19T13:33:58.055 INFO:teuthology.orchestra.run.smithi144.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: inih-devel x86_64 49-6.el9 crb 11 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: libblkid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 17 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: libedit-devel x86_64 3.1-38.20210216cvs.el9 CentOS-AppStream 39 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: libicu-devel x86_64 67.1-9.el9 CentOS-AppStream 830 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: userspace-rcu-devel x86_64 0.12.1-6.el9 crb 120 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-19T13:33:58.056 INFO:teuthology.orchestra.run.smithi144.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: python-unversioned-command 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-19T13:33:58.057 INFO:teuthology.orchestra.run.smithi144.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 3.5-1.el9 CentOS-AppStream 114 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 3.5-1.el9 CentOS-AppStream 40 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.40-2.el9 appstream 515 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.40-2.el9 appstream 217 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.40-2.el9 appstream 206 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: systemd-devel x86_64 252-18.el9 CentOS-AppStream 482 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-19T13:33:58.058 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:Install 24 Packages 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 16 Packages 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 78 M 2023-12-19T13:33:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-12-19T13:33:58.874 INFO:teuthology.orchestra.run.smithi144.stdout:(1/40): fio-engine-http-3.35-1.el9.x86_64.rpm 68 kB/s | 17 kB 00:00 2023-12-19T13:33:58.890 INFO:teuthology.orchestra.run.smithi144.stdout:(2/40): fio-engine-libaio-3.35-1.el9.x86_64.rpm 55 kB/s | 14 kB 00:00 2023-12-19T13:33:59.182 INFO:teuthology.orchestra.run.smithi144.stdout:(3/40): fio-engine-nbd-3.35-1.el9.x86_64.rpm 44 kB/s | 13 kB 00:00 2023-12-19T13:33:59.199 INFO:teuthology.orchestra.run.smithi144.stdout:(4/40): fio-engine-rados-3.35-1.el9.x86_64.rpm 47 kB/s | 15 kB 00:00 2023-12-19T13:33:59.349 INFO:teuthology.orchestra.run.smithi144.stdout:(5/40): fio-engine-rbd-3.35-1.el9.x86_64.rpm 91 kB/s | 15 kB 00:00 2023-12-19T13:33:59.424 INFO:teuthology.orchestra.run.smithi144.stdout:(6/40): fio-engine-rdma-3.35-1.el9.x86_64.rpm 88 kB/s | 20 kB 00:00 2023-12-19T13:33:59.650 INFO:teuthology.orchestra.run.smithi144.stdout:(7/40): fio-3.35-1.el9.x86_64.rpm 6.1 MB/s | 6.2 MB 00:01 2023-12-19T13:33:59.675 INFO:teuthology.orchestra.run.smithi144.stdout:(8/40): libblkid-devel-2.37.4-15.el9.x86_64.rpm 52 kB/s | 17 kB 00:00 2023-12-19T13:33:59.700 INFO:teuthology.orchestra.run.smithi144.stdout:(9/40): libedit-devel-3.1-38.20210216cvs.el9.x8 147 kB/s | 39 kB 00:00 2023-12-19T13:33:59.759 INFO:teuthology.orchestra.run.smithi144.stdout:(10/40): libselinux-devel-3.5-1.el9.x86_64.rpm 1.4 MB/s | 114 kB 00:00 2023-12-19T13:33:59.809 INFO:teuthology.orchestra.run.smithi144.stdout:(11/40): libicu-devel-67.1-9.el9.x86_64.rpm 6.1 MB/s | 830 kB 00:00 2023-12-19T13:33:59.826 INFO:teuthology.orchestra.run.smithi144.stdout:(12/40): libsepol-devel-3.5-1.el9.x86_64.rpm 323 kB/s | 40 kB 00:00 2023-12-19T13:33:59.868 INFO:teuthology.orchestra.run.smithi144.stdout:(13/40): sqlite-3.34.1-6.el9.x86_64.rpm 7.2 MB/s | 747 kB 00:00 2023-12-19T13:33:59.885 INFO:teuthology.orchestra.run.smithi144.stdout:(14/40): rmt-1.6-6.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2023-12-19T13:33:59.918 INFO:teuthology.orchestra.run.smithi144.stdout:(15/40): systemd-devel-252-18.el9.x86_64.rpm 5.6 MB/s | 482 kB 00:00 2023-12-19T13:34:00.119 INFO:teuthology.orchestra.run.smithi144.stdout:(16/40): libnbd-1.18.1-3.el9.x86_64.rpm 670 kB/s | 166 kB 00:00 2023-12-19T13:34:00.144 INFO:teuthology.orchestra.run.smithi144.stdout:(17/40): pcre2-utf16-10.40-2.el9.x86_64.rpm 964 kB/s | 217 kB 00:00 2023-12-19T13:34:00.186 INFO:teuthology.orchestra.run.smithi144.stdout:(18/40): pcre2-devel-10.40-2.el9.x86_64.rpm 1.7 MB/s | 515 kB 00:00 2023-12-19T13:34:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:(19/40): pcre2-utf32-10.40-2.el9.x86_64.rpm 2.0 MB/s | 206 kB 00:00 2023-12-19T13:34:00.270 INFO:teuthology.orchestra.run.smithi144.stdout:(20/40): inih-devel-49-6.el9.x86_64.rpm 131 kB/s | 11 kB 00:00 2023-12-19T13:34:00.295 INFO:teuthology.orchestra.run.smithi144.stdout:(21/40): device-mapper-devel-1.02.195-3.el9.x86 290 kB/s | 43 kB 00:00 2023-12-19T13:34:00.487 INFO:teuthology.orchestra.run.smithi144.stdout:(22/40): userspace-rcu-devel-0.12.1-6.el9.x86_6 452 kB/s | 120 kB 00:00 2023-12-19T13:34:00.546 INFO:teuthology.orchestra.run.smithi144.stdout:(23/40): dump-0.4-0.51.b47.el9.x86_64.rpm 320 kB/s | 88 kB 00:00 2023-12-19T13:34:00.688 INFO:teuthology.orchestra.run.smithi144.stdout:(24/40): indent-2.2.13-4.el9.x86_64.rpm 459 kB/s | 179 kB 00:00 2023-12-19T13:34:00.880 INFO:teuthology.orchestra.run.smithi144.stdout:(25/40): cpp-11.4.1-2.3.el9.x86_64.rpm 27 MB/s | 11 MB 00:00 2023-12-19T13:34:01.164 INFO:teuthology.orchestra.run.smithi144.stdout:(26/40): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 172 kB/s | 47 kB 00:00 2023-12-19T13:34:01.638 INFO:teuthology.orchestra.run.smithi144.stdout:(27/40): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 13 MB 00:00 2023-12-19T13:34:01.755 INFO:teuthology.orchestra.run.smithi144.stdout:(28/40): libstdc++-devel-11.4.1-2.3.el9.x86_64. 3.8 MB/s | 2.2 MB 00:00 2023-12-19T13:34:02.164 INFO:teuthology.orchestra.run.smithi144.stdout:(29/40): gcc-11.4.1-2.3.el9.x86_64.rpm 20 MB/s | 32 MB 00:01 2023-12-19T13:34:02.197 INFO:teuthology.orchestra.run.smithi144.stdout:(30/40): python-unversioned-command-3.9.18-1.el 16 kB/s | 8.8 kB 00:00 2023-12-19T13:34:02.223 INFO:teuthology.orchestra.run.smithi144.stdout:(31/40): python3-devel-3.9.18-1.el9.x86_64.rpm 452 kB/s | 204 kB 00:00 2023-12-19T13:34:02.265 INFO:teuthology.orchestra.run.smithi144.stdout:(32/40): libcom_err-1.46.5-4.el9.x86_64.rpm 632 kB/s | 25 kB 00:00 2023-12-19T13:34:02.323 INFO:teuthology.orchestra.run.smithi144.stdout:(33/40): e2fsprogs-1.46.5-4.el9.x86_64.rpm 9.9 MB/s | 1.0 MB 00:00 2023-12-19T13:34:02.348 INFO:teuthology.orchestra.run.smithi144.stdout:(34/40): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2023-12-19T13:34:02.374 INFO:teuthology.orchestra.run.smithi144.stdout:(35/40): libgcc-11.4.1-2.3.el9.x86_64.rpm 935 kB/s | 92 kB 00:00 2023-12-19T13:34:02.407 INFO:teuthology.orchestra.run.smithi144.stdout:(36/40): libgomp-11.4.1-2.3.el9.x86_64.rpm 4.6 MB/s | 268 kB 00:00 2023-12-19T13:34:02.432 INFO:teuthology.orchestra.run.smithi144.stdout:(37/40): libss-1.46.5-4.el9.x86_64.rpm 375 kB/s | 31 kB 00:00 2023-12-19T13:34:02.475 INFO:teuthology.orchestra.run.smithi144.stdout:(38/40): libstdc++-11.4.1-2.3.el9.x86_64.rpm 7.4 MB/s | 735 kB 00:00 2023-12-19T13:34:02.533 INFO:teuthology.orchestra.run.smithi144.stdout:(39/40): python3-3.9.18-1.el9.x86_64.rpm 275 kB/s | 26 kB 00:00 2023-12-19T13:34:02.700 INFO:teuthology.orchestra.run.smithi144.stdout:(40/40): python3-libs-3.9.18-1.el9.x86_64.rpm 28 MB/s | 7.3 MB 00:00 2023-12-19T13:34:02.708 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-12-19T13:34:02.708 INFO:teuthology.orchestra.run.smithi144.stdout:Total 17 MB/s | 78 MB 00:04 2023-12-19T13:34:02.982 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-12-19T13:34:03.312 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-12-19T13:34:03.312 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-12-19T13:34:04.147 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-12-19T13:34:04.148 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-12-19T13:34:06.411 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-12-19T13:34:06.515 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/56 2023-12-19T13:34:06.551 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-19T13:34:06.717 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-19T13:34:06.790 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/56 2023-12-19T13:34:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/56 2023-12-19T13:34:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/56 2023-12-19T13:34:08.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:08.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:08.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:09.323 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/56 2023-12-19T13:34:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/56 2023-12-19T13:34:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/56 2023-12-19T13:34:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/56 2023-12-19T13:34:09.945 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/56 2023-12-19T13:34:11.202 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/56 2023-12-19T13:34:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-19T13:34:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-19T13:34:11.657 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.40-2.el9.x86_64 13/56 2023-12-19T13:34:11.822 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.40-2.el9.x86_64 14/56 2023-12-19T13:34:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.40-2.el9.x86_64 15/56 2023-12-19T13:34:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-19T13:34:11.964 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 17/56 2023-12-19T13:34:11.999 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 18/56 2023-12-19T13:34:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 19/56 2023-12-19T13:34:12.067 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 20/56 2023-12-19T13:34:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 21/56 2023-12-19T13:34:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 22/56 2023-12-19T13:34:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-3.35-1.el9.x86_64 23/56 2023-12-19T13:34:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rmt-2:1.6-6.el9.x86_64 24/56 2023-12-19T13:34:12.877 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : systemd-devel-252-18.el9.x86_64 25/56 2023-12-19T13:34:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-3.5-1.el9.x86_64 26/56 2023-12-19T13:34:13.053 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-3.5-1.el9.x86_64 27/56 2023-12-19T13:34:13.083 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : device-mapper-devel-9:1.02.195-3.el9.x86_64 28/56 2023-12-19T13:34:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 29/56 2023-12-19T13:34:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 30/56 2023-12-19T13:34:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T13:34:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T13:34:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 32/56 2023-12-19T13:34:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 33/56 2023-12-19T13:34:14.275 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : indent-2.2.13-4.el9.x86_64 34/56 2023-12-19T13:34:14.320 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : userspace-rcu-devel-0.12.1-6.el9.x86_64 35/56 2023-12-19T13:34:14.357 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : inih-devel-49-6.el9.x86_64 36/56 2023-12-19T13:34:14.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 37/56 2023-12-19T13:34:14.752 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libicu-devel-67.1-9.el9.x86_64 38/56 2023-12-19T13:34:14.818 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libedit-devel-3.1-38.20210216cvs.el9.x86_64 39/56 2023-12-19T13:34:14.836 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libblkid-devel-2.37.4-15.el9.x86_64 40/56 2023-12-19T13:34:14.869 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 41/56 2023-12-19T13:34:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 42/56 2023-12-19T13:34:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 43/56 2023-12-19T13:34:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 44/56 2023-12-19T13:34:14.994 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 45/56 2023-12-19T13:34:14.995 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T13:34:15.102 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T13:34:15.162 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 47/56 2023-12-19T13:34:15.195 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 48/56 2023-12-19T13:34:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 49/56 2023-12-19T13:34:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 50/56 2023-12-19T13:34:15.355 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 51/56 2023-12-19T13:34:15.355 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T13:34:15.517 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T13:34:15.550 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 53/56 2023-12-19T13:34:15.591 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 54/56 2023-12-19T13:34:15.718 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 55/56 2023-12-19T13:34:15.839 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-3.35-1.el9.x86_64 1/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libblkid-devel-2.37.4-15.el9.x86_64 8/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libedit-devel-3.1-38.20210216cvs.el9.x86_64 9/56 2023-12-19T13:34:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libicu-devel-67.1-9.el9.x86_64 10/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-3.5-1.el9.x86_64 11/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-3.5-1.el9.x86_64 12/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 13/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : systemd-devel-252-18.el9.x86_64 14/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 15/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.40-2.el9.x86_64 17/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.40-2.el9.x86_64 18/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.40-2.el9.x86_64 19/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : device-mapper-devel-9:1.02.195-3.el9.x86_64 20/56 2023-12-19T13:34:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : inih-devel-49-6.el9.x86_64 21/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : userspace-rcu-devel-0.12.1-6.el9.x86_64 22/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 23/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : indent-2.2.13-4.el9.x86_64 24/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 25/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 26/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 27/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 28/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 29/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 30/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 32/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 33/56 2023-12-19T13:34:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 34/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 35/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 36/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 37/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 38/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 39/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 40/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 41/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 42/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 43/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 44/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 45/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 47/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 48/56 2023-12-19T13:34:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libss-1.46.5-4.el9.x86_64 49/56 2023-12-19T13:34:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libss-1.46.5-3.el9.x86_64 50/56 2023-12-19T13:34:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 51/56 2023-12-19T13:34:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T13:34:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-3.9.18-1.el9.x86_64 53/56 2023-12-19T13:34:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-3.9.17-2.el9.x86_64 54/56 2023-12-19T13:34:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 55/56 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-19T13:34:18.908 INFO:teuthology.orchestra.run.smithi144.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: libss-1.46.5-4.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: python3-3.9.18-1.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: device-mapper-devel-9:1.02.195-3.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: dump-1:0.4-0.51.b47.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: fio-3.35-1.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-http-3.35-1.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-libaio-3.35-1.el9.x86_64 2023-12-19T13:34:18.909 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-nbd-3.35-1.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-rados-3.35-1.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-rbd-3.35-1.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: indent-2.2.13-4.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: inih-devel-49-6.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: libblkid-devel-2.37.4-15.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: libedit-devel-3.1-38.20210216cvs.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: libicu-devel-67.1-9.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd-1.18.1-3.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-3.5-1.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-3.5-1.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.40-2.el9.x86_64 2023-12-19T13:34:18.910 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.40-2.el9.x86_64 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.40-2.el9.x86_64 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout: rmt-2:1.6-6.el9.x86_64 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout: sqlite-3.34.1-6.el9.x86_64 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout: systemd-devel-252-18.el9.x86_64 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout: userspace-rcu-devel-0.12.1-6.el9.x86_64 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:34:18.911 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-12-19T13:34:19.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo useradd -m fsgqa 2023-12-19T13:34:19.525 INFO:teuthology.orchestra.run.smithi144.stderr:useradd: user 'fsgqa' already exists 2023-12-19T13:34:19.527 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-19T13:34:19.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo groupadd fsgqa 2023-12-19T13:34:19.594 INFO:teuthology.orchestra.run.smithi144.stderr:groupadd: group 'fsgqa' already exists 2023-12-19T13:34:19.597 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-19T13:34:19.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo useradd fsgqa2 2023-12-19T13:34:20.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo useradd 123456-fsgqa 2023-12-19T13:34:20.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c36e38640 1 Processor -- start 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c36e38640 1 -- start start 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c36e38640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c300b2ed0 0x7f5c30070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c36e38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c30071c80 con 0x7f5c3006a390 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c36e38640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300715e0 con 0x7f5c30141680 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c36e38640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c301487f0 con 0x7f5c300b2ed0 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c34bd4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5c3006a390 0x7f5c301480e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35290/0 (socket says 172.21.15.6:35290) 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.100+0000 7f5c34bd4640 1 -- 172.21.15.6:0/2888459405 learned_addr learned my addr 172.21.15.6:0/2888459405 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.101+0000 7f5c2ffff640 1 --2- 172.21.15.6:0/2888459405 >> v2:172.21.15.89:3300/0 conn(0x7f5c300b2ed0 0x7f5c30070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.101+0000 7f5c2f7fe640 1 -- 172.21.15.6:0/2888459405 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119338368 0 0) 0x7f5c30071c80 con 0x7f5c3006a390 2023-12-19T13:34:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.101+0000 7f5c2f7fe640 1 -- 172.21.15.6:0/2888459405 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c20003520 con 0x7f5c3006a390 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.101+0000 7f5c2ffff640 1 -- 172.21.15.6:0/2888459405 >> v1:172.21.15.89:6789/0 conn(0x7f5c30141680 legacy=0x7f5c30152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.101+0000 7f5c2ffff640 1 -- 172.21.15.6:0/2888459405 >> v1:172.21.15.6:6789/0 conn(0x7f5c3006a390 legacy=0x7f5c301480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.101+0000 7f5c2ffff640 1 -- 172.21.15.6:0/2888459405 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300718c0 con 0x7f5c300b2ed0 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.102+0000 7f5c2ffff640 1 --2- 172.21.15.6:0/2888459405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300b2ed0 0x7f5c30070fc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0097a0 tx=0x7f5c1c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4741a0292e2991b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.102+0000 7f5c2f7fe640 1 -- 172.21.15.6:0/2888459405 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c030610 con 0x7f5c300b2ed0 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.102+0000 7f5c2f7fe640 1 -- 172.21.15.6:0/2888459405 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c030770 con 0x7f5c300b2ed0 2023-12-19T13:34:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.102+0000 7f5c2f7fe640 1 -- 172.21.15.6:0/2888459405 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c030b00 con 0x7f5c300b2ed0 2023-12-19T13:34:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 -- 172.21.15.6:0/2888459405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300b2ed0 msgr2=0x7f5c30070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2888459405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300b2ed0 0x7f5c30070fc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0097a0 tx=0x7f5c1c02b960 comp rx=0 tx=0).stop 2023-12-19T13:34:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 -- 172.21.15.6:0/2888459405 shutdown_connections 2023-12-19T13:34:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2888459405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300b2ed0 0x7f5c30070fc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 -- 172.21.15.6:0/2888459405 >> 172.21.15.6:0/2888459405 conn(0x7f5c300bc330 msgr2=0x7f5c300bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 -- 172.21.15.6:0/2888459405 shutdown_connections 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.103+0000 7f5c36e38640 1 -- 172.21.15.6:0/2888459405 wait complete. 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.104+0000 7f5c36e38640 1 Processor -- start 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.104+0000 7f5c36e38640 1 -- start start 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c36e38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c3006a390 0x7f5c300b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c36e38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30141680 0x7f5c30142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c36e38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 0x7f5c30143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c36e38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300b5c50 con 0x7f5c30143060 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c36e38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301d4f30 con 0x7f5c30141680 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c36e38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300bb040 con 0x7f5c3006a390 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 0x7f5c30143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 0x7f5c30143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41348/0 (socket says 172.21.15.6:41348) 2023-12-19T13:34:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 -- 172.21.15.6:0/2208083784 learned_addr learned my addr 172.21.15.6:0/2208083784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c34bd4640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c3006a390 0x7f5c300b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c2ffff640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30141680 0x7f5c30142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 -- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c3006a390 msgr2=0x7f5c300b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c3006a390 0x7f5c300b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 -- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30141680 msgr2=0x7f5c30142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30141680 0x7f5c30142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 -- 172.21.15.6:0/2208083784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c009400 con 0x7f5c30143060 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c2ffff640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30141680 0x7f5c30142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c353d5640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 0x7f5c30143990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800c6b0 tx=0x7f5c2800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.105+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28003b70 con 0x7f5c30143060 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.106+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c28003cf0 con 0x7f5c30143060 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.106+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c301d5640 con 0x7f5c30143060 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.106+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28003ea0 con 0x7f5c30143060 2023-12-19T13:34:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.106+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c301d5120 con 0x7f5c30143060 2023-12-19T13:34:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.107+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c300bb4d0 con 0x7f5c30143060 2023-12-19T13:34:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.107+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c28005310 con 0x7f5c30143060 2023-12-19T13:34:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.107+0000 7f5c2d7fa640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c1406a460 0x7f5c1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.108+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c280886b0 con 0x7f5c30143060 2023-12-19T13:34:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.108+0000 7f5c34bd4640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c1406a460 0x7f5c1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.108+0000 7f5c34bd4640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c1406a460 0x7f5c1406c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c240011e0 tx=0x7f5c24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:34:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.112+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c300bb4d0 con 0x7f5c30143060 2023-12-19T13:34:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.355+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5c300bb4d0 con 0x7f5c30143060 2023-12-19T13:34:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.355+0000 7f5c2d7fa640 1 -- 172.21.15.6:0/2208083784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1264 (secure 0 0 0) 0x7f5c300bb4d0 con 0x7f5c30143060 2023-12-19T13:34:21.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:34:21.358 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","modified":"2023-12-19T13:32:09.568751Z","created":"2023-12-19T13:32:09.568751Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3301","nonce":0},{"type":"v1","addr":"172.21.15.89:6790","nonce":0}]},"addr":"172.21.15.89:6790/0","public_addr":"172.21.15.89:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-19T13:34:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:dumped monmap epoch 1 2023-12-19T13:34:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c1406a460 msgr2=0x7f5c1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c1406a460 0x7f5c1406c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c240011e0 tx=0x7f5c24009040 comp rx=0 tx=0).stop 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 msgr2=0x7f5c30143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 0x7f5c30143990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800c6b0 tx=0x7f5c2800cb70 comp rx=0 tx=0).stop 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 shutdown_connections 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5c1406a460 0x7f5c1406c920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c30143060 0x7f5c30143990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30141680 0x7f5c30142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 --2- 172.21.15.6:0/2208083784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c3006a390 0x7f5c300b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 >> 172.21.15.6:0/2208083784 conn(0x7f5c300bc330 msgr2=0x7f5c300bc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 shutdown_connections 2023-12-19T13:34:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.357+0000 7f5c36e38640 1 -- 172.21.15.6:0/2208083784 wait complete. 2023-12-19T13:34:21.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-19T13:34:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.474+0000 7f43c5b4e640 1 Processor -- start 2023-12-19T13:34:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43c5b4e640 1 -- start start 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43c5b4e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 0x7f43c00b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43c5b4e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c01498f0 con 0x7f43c0142f20 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43c5b4e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c0148fc0 con 0x7f43c0148a50 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43c5b4e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00b37e0 con 0x7f43c00a0cc0 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43bf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f43c0142f20 0x7f43c00b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35300/0 (socket says 172.21.15.6:35300) 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.475+0000 7f43bf7fe640 1 -- 172.21.15.6:0/227359 learned_addr learned my addr 172.21.15.6:0/227359 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 0x7f43c00b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609386197 0 0) 0x7f43c01498f0 con 0x7f43c0142f20 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a8003520 con 0x7f43c0142f20 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346704332 0 0) 0x7f43a8003520 con 0x7f43c0142f20 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 msgr2=0x7f43c00b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 0x7f43c00b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 >> v1:172.21.15.89:6789/0 conn(0x7f43c0148a50 legacy=0x7f43c0153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c01492a0 con 0x7f43c0142f20 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f43b0001670 con 0x7f43c0142f20 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 >> v1:172.21.15.6:6789/0 conn(0x7f43c0142f20 legacy=0x7f43c00b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 0x7f43a80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003f20 0x7f43a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8004d00 0x7f43a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00b37e0 con 0x7f43a8003f20 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a800baf0 con 0x7f43a8004d00 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a800bcb0 con 0x7f43c00a0cc0 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003f20 0x7f43a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43bf7fe640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 0x7f43a80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43bffff640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8004d00 0x7f43a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 -- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 msgr2=0x7f43a80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:34:21.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c00a0cc0 0x7f43a80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 -- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8004d00 msgr2=0x7f43a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8004d00 0x7f43a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.476+0000 7f43beffd640 1 -- 172.21.15.6:0/227359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8003520 con 0x7f43a8003f20 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.477+0000 7f43beffd640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003f20 0x7f43a80047c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009a90 tx=0x7f43a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f0b70a913ff0b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.477+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b402c680 con 0x7f43a8003f20 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.477+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b402c7e0 con 0x7f43a8003f20 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.477+0000 7f43be7fc640 1 -- 172.21.15.6:0/227359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b402cb90 con 0x7f43a8003f20 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43c5b4e640 1 -- 172.21.15.6:0/227359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003f20 msgr2=0x7f43a80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/227359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a8003f20 0x7f43a80047c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009a90 tx=0x7f43a80057f0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43bffff640 1 -- 172.21.15.6:0/227359 reap_dead start 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43c5b4e640 1 -- 172.21.15.6:0/227359 shutdown_connections 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43c5b4e640 1 -- 172.21.15.6:0/227359 >> 172.21.15.6:0/227359 conn(0x7f43c00be1e0 msgr2=0x7f43c00be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43c5b4e640 1 -- 172.21.15.6:0/227359 shutdown_connections 2023-12-19T13:34:21.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.478+0000 7f43c5b4e640 1 -- 172.21.15.6:0/227359 wait complete. 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.479+0000 7f43c5b4e640 1 Processor -- start 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.479+0000 7f43c5b4e640 1 -- start start 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8003f20 0x7f43c00a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 0x7f43c0137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c01e1710 0x7f43c0137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00a31d0 con 0x7f43c01e12b0 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c006f200 con 0x7f43a8003f20 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c013e150 con 0x7f43c01e1710 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 0x7f43c0137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 0x7f43c0137860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41362/0 (socket says 172.21.15.6:41362) 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 -- 172.21.15.6:0/1916462369 learned_addr learned my addr 172.21.15.6:0/1916462369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43bf7fe640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8003f20 0x7f43c00a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43bffff640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c01e1710 0x7f43c0137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 -- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c01e1710 msgr2=0x7f43c0137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c01e1710 0x7f43c0137da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 -- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8003f20 msgr2=0x7f43c00a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8003f20 0x7f43c00a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 -- 172.21.15.6:0/1916462369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c013e430 con 0x7f43c01e12b0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43beffd640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 0x7f43c0137860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43b4037040 tx=0x7f43b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40349d0 con 0x7f43c01e12b0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4034b30 con 0x7f43c01e12b0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c01382e0 con 0x7f43c01e12b0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b403e400 con 0x7f43c01e12b0 2023-12-19T13:34:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.480+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c006f450 con 0x7f43c01e12b0 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.481+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c0066e90 con 0x7f43c01e12b0 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.482+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43b403e560 con 0x7f43c01e12b0 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.482+0000 7f43a7fff640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43ac06a430 0x7f43ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.482+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b40aa9a0 con 0x7f43c01e12b0 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.482+0000 7f43bf7fe640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43ac06a430 0x7f43ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.483+0000 7f43bf7fe640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43ac06a430 0x7f43ac06c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43b0001050 tx=0x7f43b0000fc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:34:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.486+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43b4075fc0 con 0x7f43c01e12b0 2023-12-19T13:34:21.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.732+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f43c0073a40 con 0x7f43c01e12b0 2023-12-19T13:34:21.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.732+0000 7f43a7fff640 1 -- 172.21.15.6:0/1916462369 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f43b40795e0 con 0x7f43c01e12b0 2023-12-19T13:34:21.734 INFO:teuthology.orchestra.run.smithi006.stdout:[client.admin] 2023-12-19T13:34:21.735 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg== 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43ac06a430 msgr2=0x7f43ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43ac06a430 0x7f43ac06c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43b0001050 tx=0x7f43b0000fc0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 msgr2=0x7f43c0137860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 0x7f43c0137860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43b4037040 tx=0x7f43b4004730 comp rx=0 tx=0).stop 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 shutdown_connections 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f43ac06a430 0x7f43ac06c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43c01e1710 0x7f43c0137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c01e12b0 0x7f43c0137860 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 --2- 172.21.15.6:0/1916462369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a8003f20 0x7f43c00a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 >> 172.21.15.6:0/1916462369 conn(0x7f43c00be1e0 msgr2=0x7f43c013b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 shutdown_connections 2023-12-19T13:34:21.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:34:21.735+0000 7f43c5b4e640 1 -- 172.21.15.6:0/1916462369 wait complete. 2023-12-19T13:34:21.747 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:34:21.747 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/tmp/tmp.nnuPRzScSZxfstests-dev/local.config 2023-12-19T13:34:21.821 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.6:6789:/test export TEST_DIR=/tmp/tmp.2JNDlqAT3Etest export SCRATCH_DEV=172.21.15.6:6789:/scratch export SCRATCH_MNT=/tmp/tmp.Ca1ESYblXHscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg==" 2023-12-19T13:34:21.821 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:34:21.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/tmp/tmp.nnuPRzScSZxfstests-dev/ceph.exclude 2023-12-19T13:34:21.933 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.nnuPRzScSZxfstests-dev && exec sudo make) 2023-12-19T13:34:22.093 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize -cfi 2023-12-19T13:34:22.669 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-19T13:34:22.669 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './config.guess' 2023-12-19T13:34:22.680 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './config.sub' 2023-12-19T13:34:22.690 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './install-sh' 2023-12-19T13:34:22.701 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './ltmain.sh' 2023-12-19T13:34:22.775 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-19T13:34:22.775 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-19T13:34:22.792 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-19T13:34:22.807 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-19T13:34:22.820 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-19T13:34:22.833 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-19T13:34:22.851 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-19T13:34:22.855 INFO:teuthology.orchestra.run.smithi144.stdout:cp include/install-sh . 2023-12-19T13:34:22.857 INFO:teuthology.orchestra.run.smithi144.stdout:aclocal -I m4 2023-12-19T13:34:24.106 INFO:teuthology.orchestra.run.smithi144.stdout:autoheader 2023-12-19T13:34:24.487 INFO:teuthology.orchestra.run.smithi144.stdout:autoconf 2023-12-19T13:34:24.724 INFO:teuthology.orchestra.run.smithi144.stdout:./configure \ 2023-12-19T13:34:24.725 INFO:teuthology.orchestra.run.smithi144.stdout: --libexecdir=/usr/lib \ 2023-12-19T13:34:24.725 INFO:teuthology.orchestra.run.smithi144.stdout: --exec_prefix=/var/lib 2023-12-19T13:34:25.099 INFO:teuthology.orchestra.run.smithi144.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-19T13:34:25.099 INFO:teuthology.orchestra.run.smithi144.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-19T13:34:25.103 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to print strings... printf 2023-12-19T13:34:25.103 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... gcc 2023-12-19T13:34:25.258 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether the C compiler works... yes 2023-12-19T13:34:25.258 INFO:teuthology.orchestra.run.smithi144.stdout:checking for C compiler default output file name... a.out 2023-12-19T13:34:25.317 INFO:teuthology.orchestra.run.smithi144.stdout:checking for suffix of executables... 2023-12-19T13:34:25.394 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are cross compiling... no 2023-12-19T13:34:25.432 INFO:teuthology.orchestra.run.smithi144.stdout:checking for suffix of object files... o 2023-12-19T13:34:25.467 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... yes 2023-12-19T13:34:25.501 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... yes 2023-12-19T13:34:25.552 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-19T13:34:25.558 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-19T13:34:25.564 INFO:teuthology.orchestra.run.smithi144.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-19T13:34:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:checking for egrep... /bin/grep -E 2023-12-19T13:34:25.570 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fgrep... /bin/grep -F 2023-12-19T13:34:25.579 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ld used by gcc... /bin/ld 2023-12-19T13:34:25.583 INFO:teuthology.orchestra.run.smithi144.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-19T13:34:25.588 INFO:teuthology.orchestra.run.smithi144.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-19T13:34:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-19T13:34:26.660 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether ln -s works... yes 2023-12-19T13:34:26.675 INFO:teuthology.orchestra.run.smithi144.stdout:checking the maximum length of command line arguments... 1572864 2023-12-19T13:34:26.683 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-19T13:34:26.684 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-19T13:34:26.684 INFO:teuthology.orchestra.run.smithi144.stdout:checking for /bin/ld option to reload object files... -r 2023-12-19T13:34:26.684 INFO:teuthology.orchestra.run.smithi144.stdout:checking for objdump... objdump 2023-12-19T13:34:26.684 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to recognize dependent libraries... pass_all 2023-12-19T13:34:26.684 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dlltool... no 2023-12-19T13:34:26.685 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-19T13:34:26.685 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ar... ar 2023-12-19T13:34:26.864 INFO:teuthology.orchestra.run.smithi144.stdout:checking for archiver @FILE support... @ 2023-12-19T13:34:26.864 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strip... strip 2023-12-19T13:34:26.865 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ranlib... ranlib 2023-12-19T13:34:26.865 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gawk... gawk 2023-12-19T13:34:27.026 INFO:teuthology.orchestra.run.smithi144.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-19T13:34:27.029 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sysroot... no 2023-12-19T13:34:27.037 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a working dd... /bin/dd 2023-12-19T13:34:27.045 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-19T13:34:27.077 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mt... no 2023-12-19T13:34:27.085 INFO:teuthology.orchestra.run.smithi144.stdout:checking if : is a manifest tool... no 2023-12-19T13:34:27.165 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to run the C preprocessor... gcc -E 2023-12-19T13:34:27.493 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ANSI C header files... yes 2023-12-19T13:34:27.548 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/types.h... yes 2023-12-19T13:34:27.610 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/stat.h... yes 2023-12-19T13:34:27.667 INFO:teuthology.orchestra.run.smithi144.stdout:checking for stdlib.h... yes 2023-12-19T13:34:27.726 INFO:teuthology.orchestra.run.smithi144.stdout:checking for string.h... yes 2023-12-19T13:34:27.834 INFO:teuthology.orchestra.run.smithi144.stdout:checking for memory.h... yes 2023-12-19T13:34:27.902 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strings.h... yes 2023-12-19T13:34:28.028 INFO:teuthology.orchestra.run.smithi144.stdout:checking for inttypes.h... yes 2023-12-19T13:34:28.127 INFO:teuthology.orchestra.run.smithi144.stdout:checking for stdint.h... yes 2023-12-19T13:34:28.263 INFO:teuthology.orchestra.run.smithi144.stdout:checking for unistd.h... yes 2023-12-19T13:34:28.356 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dlfcn.h... yes 2023-12-19T13:34:28.367 INFO:teuthology.orchestra.run.smithi144.stdout:checking for objdir... .libs 2023-12-19T13:34:28.544 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-19T13:34:28.544 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-19T13:34:28.596 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-19T13:34:28.643 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc static flag -static works... no 2023-12-19T13:34:28.719 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -c -o file.o... yes 2023-12-19T13:34:28.720 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-19T13:34:28.742 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-19T13:34:28.807 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether -lc should be explicitly linked in... no 2023-12-19T13:34:28.963 INFO:teuthology.orchestra.run.smithi144.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-19T13:34:28.964 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to hardcode library paths into programs... immediate 2023-12-19T13:34:28.968 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether stripping libraries is possible... yes 2023-12-19T13:34:28.968 INFO:teuthology.orchestra.run.smithi144.stdout:checking if libtool supports shared libraries... yes 2023-12-19T13:34:28.968 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether to build shared libraries... yes 2023-12-19T13:34:28.968 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether to build static libraries... yes 2023-12-19T13:34:28.990 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... (cached) gcc 2023-12-19T13:34:29.040 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T13:34:29.041 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T13:34:29.042 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T13:34:29.042 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gmake... /usr/bin/gmake 2023-12-19T13:34:29.042 INFO:teuthology.orchestra.run.smithi144.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2023-12-19T13:34:29.043 INFO:teuthology.orchestra.run.smithi144.stdout:checking for tar... /bin/tar 2023-12-19T13:34:29.043 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gzip... /bin/gzip 2023-12-19T13:34:29.067 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc -MM is supported... yes 2023-12-19T13:34:29.068 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sort... /bin/sort 2023-12-19T13:34:29.068 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether ln -s works... yes 2023-12-19T13:34:29.069 INFO:teuthology.orchestra.run.smithi144.stdout:checking for rpm... /bin/rpm 2023-12-19T13:34:29.081 INFO:teuthology.orchestra.run.smithi144.stdout:checking for rpmbuild... no 2023-12-19T13:34:29.148 INFO:teuthology.orchestra.run.smithi144.stdout:checking assert.h usability... yes 2023-12-19T13:34:29.174 INFO:teuthology.orchestra.run.smithi144.stdout:checking assert.h presence... yes 2023-12-19T13:34:29.174 INFO:teuthology.orchestra.run.smithi144.stdout:checking for assert.h... yes 2023-12-19T13:34:29.252 INFO:teuthology.orchestra.run.smithi144.stdout:checking bstring.h usability... no 2023-12-19T13:34:29.293 INFO:teuthology.orchestra.run.smithi144.stdout:checking bstring.h presence... no 2023-12-19T13:34:29.293 INFO:teuthology.orchestra.run.smithi144.stdout:checking for bstring.h... no 2023-12-19T13:34:29.364 INFO:teuthology.orchestra.run.smithi144.stdout:checking libgen.h usability... yes 2023-12-19T13:34:29.389 INFO:teuthology.orchestra.run.smithi144.stdout:checking libgen.h presence... yes 2023-12-19T13:34:29.389 INFO:teuthology.orchestra.run.smithi144.stdout:checking for libgen.h... yes 2023-12-19T13:34:29.475 INFO:teuthology.orchestra.run.smithi144.stdout:checking dirent.h usability... yes 2023-12-19T13:34:29.503 INFO:teuthology.orchestra.run.smithi144.stdout:checking dirent.h presence... yes 2023-12-19T13:34:29.504 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dirent.h... yes 2023-12-19T13:34:29.616 INFO:teuthology.orchestra.run.smithi144.stdout:checking errno.h usability... yes 2023-12-19T13:34:29.644 INFO:teuthology.orchestra.run.smithi144.stdout:checking errno.h presence... yes 2023-12-19T13:34:29.644 INFO:teuthology.orchestra.run.smithi144.stdout:checking for errno.h... yes 2023-12-19T13:34:29.733 INFO:teuthology.orchestra.run.smithi144.stdout:checking malloc.h usability... yes 2023-12-19T13:34:29.762 INFO:teuthology.orchestra.run.smithi144.stdout:checking malloc.h presence... yes 2023-12-19T13:34:29.762 INFO:teuthology.orchestra.run.smithi144.stdout:checking for malloc.h... yes 2023-12-19T13:34:29.842 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid.h usability... no 2023-12-19T13:34:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid.h presence... no 2023-12-19T13:34:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid.h... no 2023-12-19T13:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid/uuid.h usability... yes 2023-12-19T13:34:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid/uuid.h presence... yes 2023-12-19T13:34:30.006 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid/uuid.h... yes 2023-12-19T13:34:30.088 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/uuid.h usability... no 2023-12-19T13:34:30.129 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/uuid.h presence... no 2023-12-19T13:34:30.130 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/uuid.h... no 2023-12-19T13:34:30.203 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/file.h usability... yes 2023-12-19T13:34:30.232 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/file.h presence... yes 2023-12-19T13:34:30.232 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/file.h... yes 2023-12-19T13:34:30.316 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fcntl.h usability... yes 2023-12-19T13:34:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fcntl.h presence... yes 2023-12-19T13:34:30.342 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/fcntl.h... yes 2023-12-19T13:34:30.420 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/syssgi.h usability... no 2023-12-19T13:34:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/syssgi.h presence... no 2023-12-19T13:34:30.461 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/syssgi.h... no 2023-12-19T13:34:30.572 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/param.h usability... yes 2023-12-19T13:34:30.601 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/param.h presence... yes 2023-12-19T13:34:30.601 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/param.h... yes 2023-12-19T13:34:30.619 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/stat.h... (cached) yes 2023-12-19T13:34:30.696 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/statvfs.h usability... yes 2023-12-19T13:34:30.721 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/statvfs.h presence... yes 2023-12-19T13:34:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/statvfs.h... yes 2023-12-19T13:34:30.797 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/time.h usability... yes 2023-12-19T13:34:30.825 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/time.h presence... yes 2023-12-19T13:34:30.825 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/time.h... yes 2023-12-19T13:34:30.916 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/ioctl.h usability... yes 2023-12-19T13:34:30.945 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/ioctl.h presence... yes 2023-12-19T13:34:30.945 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/ioctl.h... yes 2023-12-19T13:34:31.024 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/wait.h usability... yes 2023-12-19T13:34:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/wait.h presence... yes 2023-12-19T13:34:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/wait.h... yes 2023-12-19T13:34:31.073 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/types.h... (cached) yes 2023-12-19T13:34:31.093 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strings.h... (cached) yes 2023-12-19T13:34:31.185 INFO:teuthology.orchestra.run.smithi144.stdout:checking err.h usability... yes 2023-12-19T13:34:31.212 INFO:teuthology.orchestra.run.smithi144.stdout:checking err.h presence... yes 2023-12-19T13:34:31.212 INFO:teuthology.orchestra.run.smithi144.stdout:checking for err.h... yes 2023-12-19T13:34:31.288 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/falloc.h usability... yes 2023-12-19T13:34:31.312 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/falloc.h presence... yes 2023-12-19T13:34:31.313 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/falloc.h... yes 2023-12-19T13:34:31.394 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-19T13:34:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-19T13:34:31.437 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-19T13:34:31.512 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-19T13:34:31.555 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-19T13:34:31.555 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-19T13:34:31.630 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/platform_defs.h usability... no 2023-12-19T13:34:31.671 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/platform_defs.h presence... no 2023-12-19T13:34:31.671 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/platform_defs.h... no 2023-12-19T13:34:31.749 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfs/ioctl.h usability... no 2023-12-19T13:34:31.787 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfs/ioctl.h presence... no 2023-12-19T13:34:31.787 INFO:teuthology.orchestra.run.smithi144.stdout:checking for btrfs/ioctl.h... no 2023-12-19T13:34:31.861 INFO:teuthology.orchestra.run.smithi144.stdout:checking cifs/ioctl.h usability... no 2023-12-19T13:34:31.901 INFO:teuthology.orchestra.run.smithi144.stdout:checking cifs/ioctl.h presence... no 2023-12-19T13:34:31.901 INFO:teuthology.orchestra.run.smithi144.stdout:checking for cifs/ioctl.h... no 2023-12-19T13:34:31.976 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/mman.h usability... yes 2023-12-19T13:34:32.001 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/mman.h presence... yes 2023-12-19T13:34:32.002 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/mman.h... yes 2023-12-19T13:34:32.054 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/xfs_log_format.h... no 2023-12-19T13:34:32.149 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid_compare... no 2023-12-19T13:34:32.229 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid_compare in -luuid... yes 2023-12-19T13:34:32.372 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/xfs.h... yes 2023-12-19T13:34:32.423 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/libxfs.h... no 2023-12-19T13:34:32.485 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-19T13:34:32.558 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/xqm.h... yes 2023-12-19T13:34:32.669 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-19T13:34:32.729 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/handle.h usability... yes 2023-12-19T13:34:32.754 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/handle.h presence... yes 2023-12-19T13:34:32.754 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/handle.h... yes 2023-12-19T13:34:32.852 INFO:teuthology.orchestra.run.smithi144.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-19T13:34:32.913 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/acl.h usability... yes 2023-12-19T13:34:32.945 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/acl.h presence... yes 2023-12-19T13:34:32.945 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/acl.h... yes 2023-12-19T13:34:33.010 INFO:teuthology.orchestra.run.smithi144.stdout:checking acl/libacl.h usability... yes 2023-12-19T13:34:33.041 INFO:teuthology.orchestra.run.smithi144.stdout:checking acl/libacl.h presence... yes 2023-12-19T13:34:33.042 INFO:teuthology.orchestra.run.smithi144.stdout:checking for acl/libacl.h... yes 2023-12-19T13:34:33.128 INFO:teuthology.orchestra.run.smithi144.stdout:checking for acl_init in -lacl... yes 2023-12-19T13:34:33.194 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm-ndbm.h usability... no 2023-12-19T13:34:33.234 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm-ndbm.h presence... no 2023-12-19T13:34:33.234 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gdbm-ndbm.h... no 2023-12-19T13:34:33.298 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm/ndbm.h usability... no 2023-12-19T13:34:33.341 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm/ndbm.h presence... no 2023-12-19T13:34:33.341 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gdbm/ndbm.h... no 2023-12-19T13:34:33.406 INFO:teuthology.orchestra.run.smithi144.stdout:checking ndbm.h usability... no 2023-12-19T13:34:33.445 INFO:teuthology.orchestra.run.smithi144.stdout:checking ndbm.h presence... no 2023-12-19T13:34:33.445 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ndbm.h... no 2023-12-19T13:34:33.509 INFO:teuthology.orchestra.run.smithi144.stdout:checking libaio.h usability... yes 2023-12-19T13:34:33.540 INFO:teuthology.orchestra.run.smithi144.stdout:checking libaio.h presence... yes 2023-12-19T13:34:33.540 INFO:teuthology.orchestra.run.smithi144.stdout:checking for libaio.h... yes 2023-12-19T13:34:33.607 INFO:teuthology.orchestra.run.smithi144.stdout:checking liburing.h usability... no 2023-12-19T13:34:33.647 INFO:teuthology.orchestra.run.smithi144.stdout:checking liburing.h presence... no 2023-12-19T13:34:33.647 INFO:teuthology.orchestra.run.smithi144.stdout:checking for liburing.h... no 2023-12-19T13:34:33.714 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/capability.h usability... no 2023-12-19T13:34:33.757 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/capability.h presence... no 2023-12-19T13:34:33.757 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/capability.h... no 2023-12-19T13:34:33.821 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fiemap.h usability... yes 2023-12-19T13:34:33.843 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fiemap.h presence... yes 2023-12-19T13:34:33.844 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/fiemap.h... yes 2023-12-19T13:34:33.926 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fallocate... yes 2023-12-19T13:34:34.008 INFO:teuthology.orchestra.run.smithi144.stdout:checking for open_by_handle_at... yes 2023-12-19T13:34:34.076 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/prctl.h usability... yes 2023-12-19T13:34:34.101 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/prctl.h presence... yes 2023-12-19T13:34:34.101 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/prctl.h... yes 2023-12-19T13:34:34.167 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fs.h usability... yes 2023-12-19T13:34:34.191 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fs.h presence... yes 2023-12-19T13:34:34.191 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/fs.h... yes 2023-12-19T13:34:34.253 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfsutil.h usability... no 2023-12-19T13:34:34.292 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfsutil.h presence... no 2023-12-19T13:34:34.293 INFO:teuthology.orchestra.run.smithi144.stdout:checking for btrfsutil.h... no 2023-12-19T13:34:34.404 INFO:teuthology.orchestra.run.smithi144.stdout:checking for copy_file_range... yes 2023-12-19T13:34:34.491 INFO:teuthology.orchestra.run.smithi144.stdout:checking for SEEK_DATA... yes 2023-12-19T13:34:34.595 INFO:teuthology.orchestra.run.smithi144.stdout:checking for BMV_OF_SHARED... yes 2023-12-19T13:34:34.679 INFO:teuthology.orchestra.run.smithi144.stdout:checking for nftw... yes 2023-12-19T13:34:34.768 INFO:teuthology.orchestra.run.smithi144.stdout:checking for RLIMIT_NOFILE... yes 2023-12-19T13:34:34.846 INFO:teuthology.orchestra.run.smithi144.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-19T13:34:34.936 INFO:teuthology.orchestra.run.smithi144.stdout:checking for FICLONE... yes 2023-12-19T13:34:35.022 INFO:teuthology.orchestra.run.smithi144.stdout:checking for renameat2... yes 2023-12-19T13:34:35.105 INFO:teuthology.orchestra.run.smithi144.stdout:checking for reallocarray... yes 2023-12-19T13:34:35.194 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct mount_attr... yes 2023-12-19T13:34:35.291 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-19T13:34:35.391 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-19T13:34:35.494 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-19T13:34:35.596 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-19T13:34:35.696 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-19T13:34:35.802 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-19T13:34:35.907 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-19T13:34:35.984 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs.h usability... yes 2023-12-19T13:34:36.012 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs.h presence... yes 2023-12-19T13:34:36.012 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/btrfs.h... yes 2023-12-19T13:34:36.106 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-19T13:34:36.132 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-19T13:34:36.132 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/btrfs_tree.h... yes 2023-12-19T13:34:36.197 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-19T13:34:36.233 INFO:teuthology.orchestra.run.smithi144.stdout:configure: creating ./config.status 2023-12-19T13:34:37.514 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: creating include/builddefs 2023-12-19T13:34:37.555 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: creating include/config.h 2023-12-19T13:34:37.585 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: executing libtool commands 2023-12-19T13:34:37.680 INFO:teuthology.orchestra.run.smithi144.stdout:Building include 2023-12-19T13:34:37.691 INFO:teuthology.orchestra.run.smithi144.stdout:Building lib 2023-12-19T13:34:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: [LTDEP] 2023-12-19T13:34:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dataascii.lo 2023-12-19T13:34:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] databin.lo 2023-12-19T13:34:38.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:38.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:38.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] datapid.lo 2023-12-19T13:34:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] file_lock.lo 2023-12-19T13:34:39.122 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] forker.lo 2023-12-19T13:34:39.373 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] pattern.lo 2023-12-19T13:34:39.610 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] open_flags.lo 2023-12-19T13:34:39.865 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] random_range.lo 2023-12-19T13:34:40.238 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] string_to_tokens.lo 2023-12-19T13:34:40.444 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] str_to_bytes.lo 2023-12-19T13:34:40.697 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] tlibio.lo 2023-12-19T13:34:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] write_log.lo 2023-12-19T13:34:41.469 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] random.lo 2023-12-19T13:34:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] 2023-12-19T13:34:41.925 INFO:teuthology.orchestra.run.smithi144.stdout:Building ltp 2023-12-19T13:34:41.934 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-12-19T13:34:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] doio 2023-12-19T13:34:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsstress 2023-12-19T13:34:44.774 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsx 2023-12-19T13:34:45.732 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] growfiles 2023-12-19T13:34:46.417 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] iogen 2023-12-19T13:34:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-stress 2023-12-19T13:34:47.638 INFO:teuthology.orchestra.run.smithi144.stdout:Building src 2023-12-19T13:34:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-12-19T13:34:51.375 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-12-19T13:34:51.454 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-12-19T13:34:51.478 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-12-19T13:34:51.946 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-12-19T13:34:51.999 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dirstress 2023-12-19T13:34:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fill 2023-12-19T13:34:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fill2 2023-12-19T13:34:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] getpagesize 2023-12-19T13:34:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] holes 2023-12-19T13:34:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] lstat64 2023-12-19T13:34:54.398 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] nametest 2023-12-19T13:34:54.827 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] permname 2023-12-19T13:34:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] randholes 2023-12-19T13:34:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] runas 2023-12-19T13:34:56.047 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] truncfile 2023-12-19T13:34:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] usemem 2023-12-19T13:34:56.761 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmapcat 2023-12-19T13:34:57.079 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] append_reader 2023-12-19T13:34:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] append_writer 2023-12-19T13:34:57.747 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dirperf 2023-12-19T13:34:58.185 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] metaperf 2023-12-19T13:34:58.684 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] devzero 2023-12-19T13:34:59.046 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] feature 2023-12-19T13:34:59.436 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] alloc 2023-12-19T13:34:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fault 2023-12-19T13:35:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fstest 2023-12-19T13:35:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_access_root 2023-12-19T13:35:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] godown 2023-12-19T13:35:01.313 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] resvtest 2023-12-19T13:35:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] writemod 2023-12-19T13:35:02.044 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] writev_on_pagefault 2023-12-19T13:35:02.422 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] makeextents 2023-12-19T13:35:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] itrash 2023-12-19T13:35:03.126 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] rename 2023-12-19T13:35:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] multi_open_unlink 2023-12-19T13:35:03.765 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] unwritten_sync 2023-12-19T13:35:04.132 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] genhashnames 2023-12-19T13:35:04.522 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_holes 2023-12-19T13:35:04.874 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_writev 2023-12-19T13:35:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_truncate_cmtime 2023-12-19T13:35:05.556 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dirhash_collide 2023-12-19T13:35:05.928 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_rename_overwrite 2023-12-19T13:35:06.243 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] holetest 2023-12-19T13:35:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_truncate_self 2023-12-19T13:35:07.014 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] af_unix 2023-12-19T13:35:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_stale_pmd 2023-12-19T13:35:07.660 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_cow_race 2023-12-19T13:35:08.014 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_fallocate 2023-12-19T13:35:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsync-err 2023-12-19T13:35:08.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:08.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:08.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:08.709 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_write_ro 2023-12-19T13:35:08.991 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-19T13:35:09.350 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-19T13:35:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_ofd_locks 2023-12-19T13:35:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_collision 2023-12-19T13:35:10.476 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmap-write-concurrent 2023-12-19T13:35:10.818 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_get_file_time 2023-12-19T13:35:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_create_short_dirs 2023-12-19T13:35:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_create_long_dirs 2023-12-19T13:35:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_enospc 2023-12-19T13:35:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_writev_overlap 2023-12-19T13:35:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] checkpoint_journal 2023-12-19T13:35:12.863 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmap-rw-fault 2023-12-19T13:35:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] allocstale 2023-12-19T13:35:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_cow_memory_failure 2023-12-19T13:35:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fake-dump-rootino 2023-12-19T13:35:14.293 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dio-buf-fault 2023-12-19T13:35:14.631 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] rewinddir-test 2023-12-19T13:35:14.986 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfsctl 2023-12-19T13:35:15.380 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bstat 2023-12-19T13:35:15.797 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mtab 2023-12-19T13:35:16.162 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] getdevicesize 2023-12-19T13:35:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] preallo_rw_pattern_reader 2023-12-19T13:35:16.853 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] preallo_rw_pattern_writer 2023-12-19T13:35:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] ftrunc 2023-12-19T13:35:17.541 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] trunc 2023-12-19T13:35:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fs_perms 2023-12-19T13:35:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] testx 2023-12-19T13:35:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] looptest 2023-12-19T13:35:18.883 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] locktest 2023-12-19T13:35:19.423 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] unwritten_mmap 2023-12-19T13:35:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat_unlink_test 2023-12-19T13:35:20.135 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] deduperace 2023-12-19T13:35:20.535 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat_unlink_test_modified 2023-12-19T13:35:20.926 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_dir_offset 2023-12-19T13:35:21.235 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_futimens 2023-12-19T13:35:21.557 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_immutable 2023-12-19T13:35:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] stale_handle 2023-12-19T13:35:22.751 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] pwrite_mmap_blocked 2023-12-19T13:35:23.077 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_dir_offset2 2023-12-19T13:35:23.454 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] seek_sanity_test 2023-12-19T13:35:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] seek_copy_test 2023-12-19T13:35:24.502 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_readdir_1 2023-12-19T13:35:24.853 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_readdir_2 2023-12-19T13:35:25.181 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsync-tester 2023-12-19T13:35:25.625 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] nsexec 2023-12-19T13:35:25.983 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] cloner 2023-12-19T13:35:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] renameat2 2023-12-19T13:35:26.714 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_getcwd 2023-12-19T13:35:27.067 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] e4compact 2023-12-19T13:35:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] test-nextquota 2023-12-19T13:35:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] punch-alternating 2023-12-19T13:35:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-19T13:35:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] listxattr 2023-12-19T13:35:28.860 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dio-interleaved 2023-12-19T13:35:29.207 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_dir_type 2023-12-19T13:35:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dio-invalidate-cache 2023-12-19T13:35:29.921 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] stat_test 2023-12-19T13:35:30.394 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_encrypted_d_revalidate 2023-12-19T13:35:30.712 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr_replace_test 2023-12-19T13:35:31.063 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] swapon 2023-12-19T13:35:31.403 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mkswap 2023-12-19T13:35:31.731 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_attr_corruption 2023-12-19T13:35:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_open_tmpfiles 2023-12-19T13:35:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fscrypt-crypt-util 2023-12-19T13:35:33.307 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat_null_ocount 2023-12-19T13:35:33.653 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] splice-test 2023-12-19T13:35:34.040 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] chprojid_fail 2023-12-19T13:35:34.394 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] detached_mounts_propagation 2023-12-19T13:35:34.767 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] ext4_resize 2023-12-19T13:35:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_readdir_3 2023-12-19T13:35:35.451 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] splice2pipe 2023-12-19T13:35:35.773 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] uuid_ioctl 2023-12-19T13:35:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fiemap-tester 2023-12-19T13:35:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_stripealign 2023-12-19T13:35:36.967 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] open_by_handle 2023-12-19T13:35:37.412 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_dio 2023-12-19T13:35:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfsfind 2023-12-19T13:35:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_reflink_read_race 2023-12-19T13:35:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fssum 2023-12-19T13:35:38.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:38.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:38.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:39.189 INFO:teuthology.orchestra.run.smithi144.stdout:Building log-writes 2023-12-19T13:35:39.204 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] replay-log 2023-12-19T13:35:39.716 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-12-19T13:35:39.726 INFO:teuthology.orchestra.run.smithi144.stdout:Building aio-dio-regress 2023-12-19T13:35:39.741 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aiocp 2023-12-19T13:35:40.164 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-19T13:35:40.524 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-append-write-read-race 2023-12-19T13:35:40.883 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-cow-race 2023-12-19T13:35:41.223 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-cycle-write 2023-12-19T13:35:41.599 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-eof-race 2023-12-19T13:35:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-extend-stat 2023-12-19T13:35:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-fcntl-race 2023-12-19T13:35:42.669 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-hole-filling-race 2023-12-19T13:35:43.006 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-invalidate-failure 2023-12-19T13:35:43.385 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-invalidate-readahead 2023-12-19T13:35:43.735 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aiodio_sparse2 2023-12-19T13:35:44.138 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-subblock-eof-read 2023-12-19T13:35:44.444 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-write-verify 2023-12-19T13:35:44.808 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-19T13:35:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-19T13:35:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-last-ref-held-by-io 2023-12-19T13:35:45.814 INFO:teuthology.orchestra.run.smithi144.stdout:Building vfs 2023-12-19T13:35:45.829 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] vfstest 2023-12-19T13:35:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mount-idmapped 2023-12-19T13:35:48.727 INFO:teuthology.orchestra.run.smithi144.stdout:Building m4 2023-12-19T13:35:48.736 INFO:teuthology.orchestra.run.smithi144.stdout:Building common 2023-12-19T13:35:48.744 INFO:teuthology.orchestra.run.smithi144.stdout:Building tests 2023-12-19T13:35:48.758 INFO:teuthology.orchestra.run.smithi144.stdout:Building btrfs 2023-12-19T13:35:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/btrfs/group.list 2023-12-19T13:35:48.984 INFO:teuthology.orchestra.run.smithi144.stdout:Building ceph 2023-12-19T13:35:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ceph/group.list 2023-12-19T13:35:49.049 INFO:teuthology.orchestra.run.smithi144.stdout:Building cifs 2023-12-19T13:35:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/cifs/group.list 2023-12-19T13:35:49.109 INFO:teuthology.orchestra.run.smithi144.stdout:Building ext4 2023-12-19T13:35:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ext4/group.list 2023-12-19T13:35:49.263 INFO:teuthology.orchestra.run.smithi144.stdout:Building f2fs 2023-12-19T13:35:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/f2fs/group.list 2023-12-19T13:35:49.342 INFO:teuthology.orchestra.run.smithi144.stdout:Building generic 2023-12-19T13:35:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/generic/group.list 2023-12-19T13:35:49.728 INFO:teuthology.orchestra.run.smithi144.stdout:Building nfs 2023-12-19T13:35:49.743 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/nfs/group.list 2023-12-19T13:35:49.798 INFO:teuthology.orchestra.run.smithi144.stdout:Building ocfs2 2023-12-19T13:35:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ocfs2/group.list 2023-12-19T13:35:49.863 INFO:teuthology.orchestra.run.smithi144.stdout:Building overlay 2023-12-19T13:35:49.879 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/overlay/group.list 2023-12-19T13:35:50.035 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-12-19T13:35:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/perf/group.list 2023-12-19T13:35:50.092 INFO:teuthology.orchestra.run.smithi144.stdout:Building selftest 2023-12-19T13:35:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/selftest/group.list 2023-12-19T13:35:50.149 INFO:teuthology.orchestra.run.smithi144.stdout:Building shared 2023-12-19T13:35:50.164 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/shared/group.list 2023-12-19T13:35:50.229 INFO:teuthology.orchestra.run.smithi144.stdout:Building tmpfs 2023-12-19T13:35:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/tmpfs/group.list 2023-12-19T13:35:50.295 INFO:teuthology.orchestra.run.smithi144.stdout:Building udf 2023-12-19T13:35:50.309 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/udf/group.list 2023-12-19T13:35:50.351 INFO:teuthology.orchestra.run.smithi144.stdout:Building xfs 2023-12-19T13:35:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/xfs/group.list 2023-12-19T13:35:50.725 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.nnuPRzScSZxfstests-dev && exec sudo make install) 2023-12-19T13:35:50.852 INFO:teuthology.orchestra.run.smithi144.stdout:Building include 2023-12-19T13:35:50.863 INFO:teuthology.orchestra.run.smithi144.stdout:Building lib 2023-12-19T13:35:50.874 INFO:teuthology.orchestra.run.smithi144.stdout:Building ltp 2023-12-19T13:35:50.885 INFO:teuthology.orchestra.run.smithi144.stdout:Building src 2023-12-19T13:35:50.971 INFO:teuthology.orchestra.run.smithi144.stdout:Building log-writes 2023-12-19T13:35:50.982 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-12-19T13:35:50.992 INFO:teuthology.orchestra.run.smithi144.stdout:Building aio-dio-regress 2023-12-19T13:35:51.004 INFO:teuthology.orchestra.run.smithi144.stdout:Building vfs 2023-12-19T13:35:51.015 INFO:teuthology.orchestra.run.smithi144.stdout:Building m4 2023-12-19T13:35:51.026 INFO:teuthology.orchestra.run.smithi144.stdout:Building common 2023-12-19T13:35:51.037 INFO:teuthology.orchestra.run.smithi144.stdout:Building tests 2023-12-19T13:35:51.051 INFO:teuthology.orchestra.run.smithi144.stdout:Building btrfs 2023-12-19T13:35:51.067 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/btrfs/group.list 2023-12-19T13:35:51.290 INFO:teuthology.orchestra.run.smithi144.stdout:Building ceph 2023-12-19T13:35:51.304 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ceph/group.list 2023-12-19T13:35:51.358 INFO:teuthology.orchestra.run.smithi144.stdout:Building cifs 2023-12-19T13:35:51.372 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/cifs/group.list 2023-12-19T13:35:51.418 INFO:teuthology.orchestra.run.smithi144.stdout:Building ext4 2023-12-19T13:35:51.431 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ext4/group.list 2023-12-19T13:35:51.572 INFO:teuthology.orchestra.run.smithi144.stdout:Building f2fs 2023-12-19T13:35:51.587 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/f2fs/group.list 2023-12-19T13:35:51.651 INFO:teuthology.orchestra.run.smithi144.stdout:Building generic 2023-12-19T13:35:51.669 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/generic/group.list 2023-12-19T13:35:52.006 INFO:teuthology.orchestra.run.smithi144.stdout:Building nfs 2023-12-19T13:35:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/nfs/group.list 2023-12-19T13:35:52.077 INFO:teuthology.orchestra.run.smithi144.stdout:Building ocfs2 2023-12-19T13:35:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ocfs2/group.list 2023-12-19T13:35:52.142 INFO:teuthology.orchestra.run.smithi144.stdout:Building overlay 2023-12-19T13:35:52.157 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/overlay/group.list 2023-12-19T13:35:52.311 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-12-19T13:35:52.326 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/perf/group.list 2023-12-19T13:35:52.369 INFO:teuthology.orchestra.run.smithi144.stdout:Building selftest 2023-12-19T13:35:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/selftest/group.list 2023-12-19T13:35:52.428 INFO:teuthology.orchestra.run.smithi144.stdout:Building shared 2023-12-19T13:35:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/shared/group.list 2023-12-19T13:35:52.503 INFO:teuthology.orchestra.run.smithi144.stdout:Building tmpfs 2023-12-19T13:35:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/tmpfs/group.list 2023-12-19T13:35:52.563 INFO:teuthology.orchestra.run.smithi144.stdout:Building udf 2023-12-19T13:35:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/udf/group.list 2023-12-19T13:35:52.617 INFO:teuthology.orchestra.run.smithi144.stdout:Building xfs 2023-12-19T13:35:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.nnuPRzScSZxfstests-dev/tests/xfs/group.list 2023-12-19T13:35:52.980 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-19T13:35:52.984 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T13:35:52.984 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-19T13:35:52.989 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T13:35:52.990 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-19T13:35:52.995 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-19T13:35:53.027 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-19T13:35:53.261 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-19T13:35:53.294 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-19T13:35:53.339 INFO:teuthology.orchestra.run.smithi144.stdout:Building log-writes 2023-12-19T13:35:53.349 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-12-19T13:35:53.360 INFO:teuthology.orchestra.run.smithi144.stdout:Building aio-dio-regress 2023-12-19T13:35:53.372 INFO:teuthology.orchestra.run.smithi144.stdout:Building vfs 2023-12-19T13:35:53.380 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C log-writes install 2023-12-19T13:35:53.384 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-19T13:35:53.417 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-19T13:35:53.450 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C perf install 2023-12-19T13:35:53.454 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-19T13:35:53.484 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-19T13:35:53.560 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-19T13:35:53.564 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-19T13:35:53.598 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-19T13:35:53.788 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C vfs install 2023-12-19T13:35:53.792 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-19T13:35:53.823 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-19T13:35:53.864 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-19T13:35:53.896 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-19T13:35:58.226 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-19T13:35:58.571 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-19T13:35:58.644 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-19T13:35:58.647 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T13:35:58.648 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-19T13:35:58.652 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-19T13:35:58.681 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-19T13:35:59.176 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-19T13:35:59.180 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/btrfs/ install 2023-12-19T13:35:59.186 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-19T13:35:59.218 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-19T13:36:02.566 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-19T13:36:02.599 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-19T13:36:05.713 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ceph/ install 2023-12-19T13:36:05.717 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-19T13:36:05.751 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-19T13:36:05.825 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-19T13:36:05.857 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-19T13:36:05.928 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/cifs/ install 2023-12-19T13:36:05.932 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-19T13:36:05.965 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-19T13:36:05.996 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-19T13:36:06.029 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-19T13:36:06.059 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ext4/ install 2023-12-19T13:36:06.063 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-19T13:36:06.095 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-19T13:36:06.767 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-19T13:36:06.799 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-19T13:36:07.516 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/f2fs/ install 2023-12-19T13:36:07.521 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-19T13:36:07.552 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-19T13:36:07.592 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-19T13:36:07.624 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-19T13:36:07.668 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/generic/ install 2023-12-19T13:36:07.679 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-19T13:36:07.711 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-19T13:36:08.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:08.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:08.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:15.177 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-19T13:36:15.211 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-19T13:36:23.938 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/nfs/ install 2023-12-19T13:36:23.942 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-19T13:36:23.977 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-19T13:36:24.010 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-19T13:36:24.043 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-19T13:36:24.077 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/ocfs2/ install 2023-12-19T13:36:24.081 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-19T13:36:24.115 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-19T13:36:24.147 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-19T13:36:24.180 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-19T13:36:24.214 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/overlay/ install 2023-12-19T13:36:24.218 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-19T13:36:24.253 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-19T13:36:25.283 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-19T13:36:25.318 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-19T13:36:26.388 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/perf/ install 2023-12-19T13:36:26.392 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-19T13:36:26.426 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-19T13:36:26.459 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-19T13:36:26.492 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-19T13:36:26.525 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/selftest/ install 2023-12-19T13:36:26.528 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-19T13:36:26.562 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-19T13:36:26.639 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-19T13:36:26.666 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-19T13:36:26.738 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/shared/ install 2023-12-19T13:36:26.742 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-19T13:36:26.770 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-19T13:36:26.817 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-19T13:36:26.847 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-19T13:36:26.896 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/tmpfs/ install 2023-12-19T13:36:26.900 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-19T13:36:26.932 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-19T13:36:26.965 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-19T13:36:26.998 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-19T13:36:27.034 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/udf/ install 2023-12-19T13:36:27.036 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-19T13:36:27.070 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-19T13:36:27.104 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-19T13:36:27.137 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-19T13:36:27.171 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nnuPRzScSZxfstests-dev/tests/xfs/ install 2023-12-19T13:36:27.181 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-19T13:36:27.215 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-19T13:36:34.436 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-19T13:36:34.469 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-19T13:36:39.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:39.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:39.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:41.435 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-19T13:36:41.467 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-19T13:36:41.501 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-19T13:36:41.535 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-19T13:36:41.574 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.QMOkoB2Hnrxfsprogs-dev && exec sudo make) 2023-12-19T13:36:41.682 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize -c -i -f 2023-12-19T13:36:42.061 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-12-19T13:36:42.061 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './config.guess' 2023-12-19T13:36:42.075 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './config.sub' 2023-12-19T13:36:42.090 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './install-sh' 2023-12-19T13:36:42.106 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './ltmain.sh' 2023-12-19T13:36:42.205 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-19T13:36:42.205 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-19T13:36:42.228 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-19T13:36:42.251 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-19T13:36:42.275 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-19T13:36:42.298 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-19T13:36:42.328 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-19T13:36:42.334 INFO:teuthology.orchestra.run.smithi144.stdout:cp include/install-sh . 2023-12-19T13:36:42.337 INFO:teuthology.orchestra.run.smithi144.stdout:aclocal -I m4 2023-12-19T13:36:43.763 INFO:teuthology.orchestra.run.smithi144.stdout:autoconf 2023-12-19T13:36:44.272 INFO:teuthology.orchestra.run.smithi144.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-12-19T13:36:44.455 INFO:teuthology.orchestra.run.smithi144.stdout:configure: loading site script /usr/share/config.site 2023-12-19T13:36:44.500 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a BSD-compatible install... /bin/install -c 2023-12-19T13:36:44.633 INFO:teuthology.orchestra.run.smithi144.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-19T13:36:44.633 INFO:teuthology.orchestra.run.smithi144.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-19T13:36:44.638 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to print strings... printf 2023-12-19T13:36:44.639 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... gcc 2023-12-19T13:36:44.774 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether the C compiler works... yes 2023-12-19T13:36:44.775 INFO:teuthology.orchestra.run.smithi144.stdout:checking for C compiler default output file name... a.out 2023-12-19T13:36:44.846 INFO:teuthology.orchestra.run.smithi144.stdout:checking for suffix of executables... 2023-12-19T13:36:44.928 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are cross compiling... no 2023-12-19T13:36:44.980 INFO:teuthology.orchestra.run.smithi144.stdout:checking for suffix of object files... o 2023-12-19T13:36:45.026 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... yes 2023-12-19T13:36:45.074 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... yes 2023-12-19T13:36:45.140 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-19T13:36:45.149 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-19T13:36:45.158 INFO:teuthology.orchestra.run.smithi144.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-19T13:36:45.163 INFO:teuthology.orchestra.run.smithi144.stdout:checking for egrep... /bin/grep -E 2023-12-19T13:36:45.169 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fgrep... /bin/grep -F 2023-12-19T13:36:45.181 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ld used by gcc... /bin/ld 2023-12-19T13:36:45.188 INFO:teuthology.orchestra.run.smithi144.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-19T13:36:45.196 INFO:teuthology.orchestra.run.smithi144.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-19T13:36:45.282 INFO:teuthology.orchestra.run.smithi144.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-19T13:36:45.282 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether ln -s works... yes 2023-12-19T13:36:45.295 INFO:teuthology.orchestra.run.smithi144.stdout:checking the maximum length of command line arguments... 1572864 2023-12-19T13:36:45.305 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-19T13:36:45.306 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-19T13:36:45.306 INFO:teuthology.orchestra.run.smithi144.stdout:checking for /bin/ld option to reload object files... -r 2023-12-19T13:36:45.307 INFO:teuthology.orchestra.run.smithi144.stdout:checking for objdump... objdump 2023-12-19T13:36:45.308 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to recognize dependent libraries... pass_all 2023-12-19T13:36:45.308 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dlltool... no 2023-12-19T13:36:45.309 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-19T13:36:45.310 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ar... ar 2023-12-19T13:36:45.405 INFO:teuthology.orchestra.run.smithi144.stdout:checking for archiver @FILE support... @ 2023-12-19T13:36:45.406 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strip... strip 2023-12-19T13:36:45.407 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ranlib... ranlib 2023-12-19T13:36:45.408 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gawk... gawk 2023-12-19T13:36:45.591 INFO:teuthology.orchestra.run.smithi144.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-19T13:36:45.596 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sysroot... no 2023-12-19T13:36:45.607 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a working dd... /bin/dd 2023-12-19T13:36:45.618 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-19T13:36:45.661 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mt... no 2023-12-19T13:36:45.669 INFO:teuthology.orchestra.run.smithi144.stdout:checking if : is a manifest tool... no 2023-12-19T13:36:45.735 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to run the C preprocessor... gcc -E 2023-12-19T13:36:46.013 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ANSI C header files... yes 2023-12-19T13:36:46.072 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/types.h... yes 2023-12-19T13:36:46.145 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/stat.h... yes 2023-12-19T13:36:46.220 INFO:teuthology.orchestra.run.smithi144.stdout:checking for stdlib.h... yes 2023-12-19T13:36:46.293 INFO:teuthology.orchestra.run.smithi144.stdout:checking for string.h... yes 2023-12-19T13:36:46.365 INFO:teuthology.orchestra.run.smithi144.stdout:checking for memory.h... yes 2023-12-19T13:36:46.433 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strings.h... yes 2023-12-19T13:36:46.509 INFO:teuthology.orchestra.run.smithi144.stdout:checking for inttypes.h... yes 2023-12-19T13:36:46.582 INFO:teuthology.orchestra.run.smithi144.stdout:checking for stdint.h... yes 2023-12-19T13:36:46.658 INFO:teuthology.orchestra.run.smithi144.stdout:checking for unistd.h... yes 2023-12-19T13:36:46.727 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dlfcn.h... yes 2023-12-19T13:36:46.740 INFO:teuthology.orchestra.run.smithi144.stdout:checking for objdir... .libs 2023-12-19T13:36:46.909 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-19T13:36:46.910 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-19T13:36:46.962 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-19T13:36:47.010 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc static flag -static works... no 2023-12-19T13:36:47.083 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -c -o file.o... yes 2023-12-19T13:36:47.083 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-19T13:36:47.106 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-19T13:36:47.176 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether -lc should be explicitly linked in... no 2023-12-19T13:36:47.315 INFO:teuthology.orchestra.run.smithi144.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-19T13:36:47.315 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to hardcode library paths into programs... immediate 2023-12-19T13:36:47.319 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether stripping libraries is possible... yes 2023-12-19T13:36:47.319 INFO:teuthology.orchestra.run.smithi144.stdout:checking if libtool supports shared libraries... yes 2023-12-19T13:36:47.319 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether to build shared libraries... yes 2023-12-19T13:36:47.319 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether to build static libraries... yes 2023-12-19T13:36:47.319 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... (cached) gcc 2023-12-19T13:36:47.367 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T13:36:47.367 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T13:36:47.367 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T13:36:47.382 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... (cached) gcc 2023-12-19T13:36:47.427 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T13:36:47.427 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T13:36:47.427 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T13:36:47.437 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... (cached) gcc 2023-12-19T13:36:47.482 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T13:36:47.482 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T13:36:47.482 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T13:36:47.482 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gmake... /bin/gmake 2023-12-19T13:36:47.484 INFO:teuthology.orchestra.run.smithi144.stdout:checking for tar... /bin/tar 2023-12-19T13:36:47.484 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gzip... /bin/gzip 2023-12-19T13:36:47.507 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc -MM is supported... yes 2023-12-19T13:36:47.508 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sort... /bin/sort 2023-12-19T13:36:47.508 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether ln -s works... yes 2023-12-19T13:36:47.509 INFO:teuthology.orchestra.run.smithi144.stdout:checking for msgfmt... /bin/msgfmt 2023-12-19T13:36:47.509 INFO:teuthology.orchestra.run.smithi144.stdout:checking for msgmerge... /bin/msgmerge 2023-12-19T13:36:47.509 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xgettext... /bin/xgettext 2023-12-19T13:36:47.510 INFO:teuthology.orchestra.run.smithi144.stdout:checking for rpm... /bin/rpm 2023-12-19T13:36:47.520 INFO:teuthology.orchestra.run.smithi144.stdout:checking for rpmbuild... no 2023-12-19T13:36:47.577 INFO:teuthology.orchestra.run.smithi144.stdout:checking ini.h usability... yes 2023-12-19T13:36:47.607 INFO:teuthology.orchestra.run.smithi144.stdout:checking ini.h presence... yes 2023-12-19T13:36:47.607 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ini.h... yes 2023-12-19T13:36:47.688 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ini_parse in -linih... yes 2023-12-19T13:36:47.761 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid.h usability... no 2023-12-19T13:36:47.804 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid.h presence... no 2023-12-19T13:36:47.805 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid.h... no 2023-12-19T13:36:47.875 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/uuid.h usability... no 2023-12-19T13:36:47.912 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/uuid.h presence... no 2023-12-19T13:36:47.912 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/uuid.h... no 2023-12-19T13:36:47.979 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid/uuid.h usability... yes 2023-12-19T13:36:48.007 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid/uuid.h presence... yes 2023-12-19T13:36:48.007 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid/uuid.h... yes 2023-12-19T13:36:48.109 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid_compare... no 2023-12-19T13:36:48.187 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid_compare in -luuid... yes 2023-12-19T13:36:48.252 INFO:teuthology.orchestra.run.smithi144.stdout:checking pthread.h usability... yes 2023-12-19T13:36:48.278 INFO:teuthology.orchestra.run.smithi144.stdout:checking pthread.h presence... yes 2023-12-19T13:36:48.278 INFO:teuthology.orchestra.run.smithi144.stdout:checking for pthread.h... yes 2023-12-19T13:36:48.356 INFO:teuthology.orchestra.run.smithi144.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-12-19T13:36:48.428 INFO:teuthology.orchestra.run.smithi144.stdout:checking urcu.h usability... yes 2023-12-19T13:36:48.462 INFO:teuthology.orchestra.run.smithi144.stdout:checking urcu.h presence... yes 2023-12-19T13:36:48.463 INFO:teuthology.orchestra.run.smithi144.stdout:checking for urcu.h... yes 2023-12-19T13:36:48.529 INFO:teuthology.orchestra.run.smithi144.stdout:checking for liburcu... yes 2023-12-19T13:36:48.580 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fadvise ... yes 2023-12-19T13:36:48.632 INFO:teuthology.orchestra.run.smithi144.stdout:checking for madvise ... yes 2023-12-19T13:36:48.684 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mincore ... yes 2023-12-19T13:36:48.745 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sendfile ... yes 2023-12-19T13:36:48.798 INFO:teuthology.orchestra.run.smithi144.stdout:checking for getmntent ... yes 2023-12-19T13:36:48.878 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fallocate... yes 2023-12-19T13:36:48.964 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fiemap... yes 2023-12-19T13:36:49.048 INFO:teuthology.orchestra.run.smithi144.stdout:checking for pwritev2... yes 2023-12-19T13:36:49.132 INFO:teuthology.orchestra.run.smithi144.stdout:checking for preadv... yes 2023-12-19T13:36:49.218 INFO:teuthology.orchestra.run.smithi144.stdout:checking for copy_file_range... yes 2023-12-19T13:36:49.299 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sync_file_range... yes 2023-12-19T13:36:49.383 INFO:teuthology.orchestra.run.smithi144.stdout:checking for syncfs... yes 2023-12-19T13:36:49.444 INFO:teuthology.orchestra.run.smithi144.stdout:checking mntent.h usability... yes 2023-12-19T13:36:49.467 INFO:teuthology.orchestra.run.smithi144.stdout:checking mntent.h presence... yes 2023-12-19T13:36:49.467 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mntent.h... yes 2023-12-19T13:36:49.531 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether fls is declared... no 2023-12-19T13:36:49.613 INFO:teuthology.orchestra.run.smithi144.stdout:checking for readdir... yes 2023-12-19T13:36:49.679 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether fsetxattr is declared... yes 2023-12-19T13:36:49.744 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether mremap is declared... yes 2023-12-19T13:36:49.844 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct fsxattr... yes 2023-12-19T13:36:49.898 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-12-19T13:36:49.992 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct fscrypt_add_key_arg... yes 2023-12-19T13:36:50.044 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-12-19T13:36:50.131 INFO:teuthology.orchestra.run.smithi144.stdout:checking for GETFSMAP... yes 2023-12-19T13:36:50.227 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct statfs... yes 2023-12-19T13:36:50.281 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct statfs.f_flags... yes 2023-12-19T13:36:50.329 INFO:teuthology.orchestra.run.smithi144.stdout:checking for MAP_SYNC... yes 2023-12-19T13:36:50.512 INFO:teuthology.orchestra.run.smithi144.stdout:checking for library containing dm_task_create... -ldevmapper 2023-12-19T13:36:50.569 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mallinfo ... yes 2023-12-19T13:36:50.623 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mallinfo2 ... yes 2023-12-19T13:36:50.685 INFO:teuthology.orchestra.run.smithi144.stdout:checking attr/attributes.h usability... yes 2023-12-19T13:36:50.713 INFO:teuthology.orchestra.run.smithi144.stdout:checking attr/attributes.h presence... yes 2023-12-19T13:36:50.714 INFO:teuthology.orchestra.run.smithi144.stdout:checking for attr/attributes.h... yes 2023-12-19T13:36:50.769 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct attrlist_cursor... yes 2023-12-19T13:36:50.773 INFO:teuthology.orchestra.run.smithi144.stdout:checking for pkg-config... /bin/pkg-config 2023-12-19T13:36:50.793 INFO:teuthology.orchestra.run.smithi144.stdout:checking pkg-config is at least version 0.9.0... yes 2023-12-19T13:36:50.879 INFO:teuthology.orchestra.run.smithi144.stdout:checking for libicu... yes 2023-12-19T13:36:50.950 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether openat is declared... yes 2023-12-19T13:36:51.023 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether fstatat is declared... yes 2023-12-19T13:36:51.090 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct sg_io_hdr ... yes 2023-12-19T13:36:51.155 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct hd_geometry ... yes 2023-12-19T13:36:51.245 INFO:teuthology.orchestra.run.smithi144.stdout:checking for systemd... yes 2023-12-19T13:36:51.266 INFO:teuthology.orchestra.run.smithi144.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-12-19T13:36:51.267 INFO:teuthology.orchestra.run.smithi144.stdout:checking for system crontab dir... /etc/cron.d 2023-12-19T13:36:51.350 INFO:teuthology.orchestra.run.smithi144.stdout:checking for udev... yes 2023-12-19T13:36:51.370 INFO:teuthology.orchestra.run.smithi144.stdout:checking for udev rule dir... /usr/lib/udev/rules.d 2023-12-19T13:36:51.564 INFO:teuthology.orchestra.run.smithi144.stdout:checking for library containing blkid_probe_all... -lblkid 2023-12-19T13:36:51.654 INFO:teuthology.orchestra.run.smithi144.stdout:checking for blkid_probe_get_topology... yes 2023-12-19T13:36:51.771 INFO:teuthology.orchestra.run.smithi144.stdout:checking size of long... 8 2023-12-19T13:36:51.887 INFO:teuthology.orchestra.run.smithi144.stdout:checking size of char *... 8 2023-12-19T13:36:51.932 INFO:teuthology.orchestra.run.smithi144.stdout:checking for umode_t... no 2023-12-19T13:36:52.044 INFO:teuthology.orchestra.run.smithi144.stdout:checking for atomic64_t support in liburcu... yes 2023-12-19T13:36:52.082 INFO:teuthology.orchestra.run.smithi144.stdout:configure: creating ./config.status 2023-12-19T13:36:53.380 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: creating include/builddefs 2023-12-19T13:36:53.420 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: creating include/platform_defs.h 2023-12-19T13:36:53.455 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: executing libtool commands 2023-12-19T13:36:53.582 INFO:teuthology.orchestra.run.smithi144.stdout: [HEADERS] include 2023-12-19T13:36:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: [HEADERS] libxfs 2023-12-19T13:36:53.645 INFO:teuthology.orchestra.run.smithi144.stdout:Building include 2023-12-19T13:36:53.659 INFO:teuthology.orchestra.run.smithi144.stdout: [LN] disk 2023-12-19T13:36:53.665 INFO:teuthology.orchestra.run.smithi144.stdout:Building libfrog 2023-12-19T13:36:53.675 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] gen_crc32table 2023-12-19T13:36:53.767 INFO:teuthology.orchestra.run.smithi144.stdout: [GENERATE] crc32table.h 2023-12-19T13:36:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] avl64.lo 2023-12-19T13:36:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bitmap.lo 2023-12-19T13:36:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat.lo 2023-12-19T13:36:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] convert.lo 2023-12-19T13:36:57.020 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] crc32.lo 2023-12-19T13:36:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsgeom.lo 2023-12-19T13:36:58.091 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] list_sort.lo 2023-12-19T13:36:58.531 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] linux.lo 2023-12-19T13:36:59.134 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] logging.lo 2023-12-19T13:36:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] paths.lo 2023-12-19T13:37:00.314 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] projects.lo 2023-12-19T13:37:00.867 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] ptvar.lo 2023-12-19T13:37:01.381 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] radix-tree.lo 2023-12-19T13:37:02.164 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] randbytes.lo 2023-12-19T13:37:02.605 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] scrub.lo 2023-12-19T13:37:03.092 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] util.lo 2023-12-19T13:37:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] workqueue.lo 2023-12-19T13:37:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] libfrog.la 2023-12-19T13:37:04.315 INFO:teuthology.orchestra.run.smithi144.stdout:Building libxfs 2023-12-19T13:37:06.717 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] cache.lo 2023-12-19T13:37:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] defer_item.lo 2023-12-19T13:37:08.234 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] init.lo 2023-12-19T13:37:09.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:09.295 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] kmem.lo 2023-12-19T13:37:09.297 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:09.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] logitem.lo 2023-12-19T13:37:10.328 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] rdwr.lo 2023-12-19T13:37:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] topology.lo 2023-12-19T13:37:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] trans.lo 2023-12-19T13:37:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] util.lo 2023-12-19T13:37:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_ag.lo 2023-12-19T13:37:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_ag_resv.lo 2023-12-19T13:37:15.543 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_alloc.lo 2023-12-19T13:37:17.377 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_alloc_btree.lo 2023-12-19T13:37:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_attr.lo 2023-12-19T13:37:19.059 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_attr_leaf.lo 2023-12-19T13:37:20.745 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_attr_remote.lo 2023-12-19T13:37:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_bit.lo 2023-12-19T13:37:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_bmap.lo 2023-12-19T13:37:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_bmap_btree.lo 2023-12-19T13:37:26.096 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_btree.lo 2023-12-19T13:37:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_btree_staging.lo 2023-12-19T13:37:29.299 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_da_btree.lo 2023-12-19T13:37:30.921 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_defer.lo 2023-12-19T13:37:31.721 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dir2.lo 2023-12-19T13:37:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dir2_block.lo 2023-12-19T13:37:33.714 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dir2_data.lo 2023-12-19T13:37:34.805 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dir2_leaf.lo 2023-12-19T13:37:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dir2_node.lo 2023-12-19T13:37:37.390 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dir2_sf.lo 2023-12-19T13:37:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_dquot_buf.lo 2023-12-19T13:37:39.135 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_ialloc.lo 2023-12-19T13:37:39.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:39.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:39.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:40.717 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_iext_tree.lo 2023-12-19T13:37:41.776 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_inode_buf.lo 2023-12-19T13:37:42.705 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_inode_fork.lo 2023-12-19T13:37:43.665 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_ialloc_btree.lo 2023-12-19T13:37:44.511 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_log_rlimit.lo 2023-12-19T13:37:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_refcount.lo 2023-12-19T13:37:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_refcount_btree.lo 2023-12-19T13:37:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_rmap.lo 2023-12-19T13:37:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_rmap_btree.lo 2023-12-19T13:37:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_rtbitmap.lo 2023-12-19T13:37:50.339 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_sb.lo 2023-12-19T13:37:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_symlink_remote.lo 2023-12-19T13:37:52.158 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_trans_inode.lo 2023-12-19T13:37:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_trans_resv.lo 2023-12-19T13:37:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_types.lo 2023-12-19T13:37:54.268 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] libxfs.la 2023-12-19T13:37:54.600 INFO:teuthology.orchestra.run.smithi144.stdout:Building libxlog 2023-12-19T13:37:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_log_recover.lo 2023-12-19T13:37:55.889 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] util.lo 2023-12-19T13:37:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] libxlog.la 2023-12-19T13:37:56.655 INFO:teuthology.orchestra.run.smithi144.stdout:Building libxcmd 2023-12-19T13:37:56.850 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] command.lo 2023-12-19T13:37:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] input.lo 2023-12-19T13:37:57.994 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] help.lo 2023-12-19T13:37:58.521 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] quit.lo 2023-12-19T13:37:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] libxcmd.la 2023-12-19T13:37:59.195 INFO:teuthology.orchestra.run.smithi144.stdout:Building libhandle 2023-12-19T13:37:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] handle.lo 2023-12-19T13:37:59.922 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] jdm.lo 2023-12-19T13:38:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] libhandle.la 2023-12-19T13:38:00.706 INFO:teuthology.orchestra.run.smithi144.stdout:Building copy 2023-12-19T13:38:00.783 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_copy.o 2023-12-19T13:38:01.288 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_copy 2023-12-19T13:38:01.543 INFO:teuthology.orchestra.run.smithi144.stdout:Building db 2023-12-19T13:38:04.491 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] addr.o 2023-12-19T13:38:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] agf.o 2023-12-19T13:38:04.785 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] agfl.o 2023-12-19T13:38:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] agi.o 2023-12-19T13:38:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr.o 2023-12-19T13:38:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attrshort.o 2023-12-19T13:38:05.477 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bit.o 2023-12-19T13:38:05.638 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] block.o 2023-12-19T13:38:05.824 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bmap.o 2023-12-19T13:38:06.061 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] btblock.o 2023-12-19T13:38:06.236 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bmroot.o 2023-12-19T13:38:06.444 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] check.o 2023-12-19T13:38:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] command.o 2023-12-19T13:38:08.503 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] crc.o 2023-12-19T13:38:08.658 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] debug.o 2023-12-19T13:38:08.782 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dir2.o 2023-12-19T13:38:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dir2sf.o 2023-12-19T13:38:09.315 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dquot.o 2023-12-19T13:38:09.466 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] echo.o 2023-12-19T13:38:09.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:09.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:09.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] faddr.o 2023-12-19T13:38:09.824 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] field.o 2023-12-19T13:38:09.982 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] flist.o 2023-12-19T13:38:10.271 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fprint.o 2023-12-19T13:38:10.484 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] frag.o 2023-12-19T13:38:10.780 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] freesp.o 2023-12-19T13:38:11.028 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] hash.o 2023-12-19T13:38:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c: In function ‘hash_f’: 2023-12-19T13:38:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of ‘libxfs_da_hashname’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.118 INFO:teuthology.orchestra.run.smithi144.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-12-19T13:38:11.118 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~^~~ 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr: | char * 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/libxfs.h:59, 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected ‘const uint8_t *’ {aka ‘const unsigned char *’} but argument is of type ‘char *’ 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-12-19T13:38:11.119 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c: In function ‘collide_dirents’: 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of ‘openat’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~ 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr: | const unsigned char * 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from /usr/include/features.h:490, 2023-12-19T13:38:11.122 INFO:teuthology.orchestra.run.smithi144.stderr: from /usr/include/bits/libc-header-start.h:33, 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: from /usr/include/stdio.h:27, 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/platform_defs.h:10, 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/fcntl.h:237:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: 237 | extern int __REDIRECT (openat, (int __fd, const char *__file, int __oflag, 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~~ 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~~ 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: | unsigned char * 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/platform_defs.h:17, 2023-12-19T13:38:11.123 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/string.h:128:40: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: 128 | extern char *strncpy (char *__restrict __dest, 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~^~~~~~ 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~ 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: | const unsigned char * 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/platform_defs.h:17, 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.124 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/string.h:129:46: note: expected ‘const char * restrict’ but argument is of type ‘const unsigned char *’ 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: 129 | const char *__restrict __src, size_t __n) 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~^~~~~ 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~ 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: | const unsigned char * 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/platform_defs.h:19, 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/unistd.h:825:46: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T13:38:11.125 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~~ 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: | unsigned char * 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/platform_defs.h:19, 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/unistd.h:826:32: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: 826 | const char *__to, int __flags) 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~^~~~ 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c: In function ‘collide_xattrs’: 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-19T13:38:11.126 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~ 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: | unsigned char * 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/platform_defs.h:10, 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~ 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr: | unsigned char * 2023-12-19T13:38:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from hash.c:16: 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~ 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: | unsigned char * 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from ../include/platform_defs.h:10, 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: from ../include/libxfs.h:11, 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: from hash.c:7: 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-19T13:38:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~~~~~~~ 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: | unsigned char * 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:In file included from hash.c:16: 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c: In function ‘hashcoll_f’: 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~ 2023-12-19T13:38:11.129 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: | char * 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: 300 | const unsigned char *name, 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: | ^~~ 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: | char * 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: 234 | const unsigned char *name, 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T13:38:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~^~~ 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | char * 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: 300 | const unsigned char *name, 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~^~~ 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | | 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: | char * 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T13:38:11.131 INFO:teuthology.orchestra.run.smithi144.stderr: 234 | const unsigned char *name, 2023-12-19T13:38:11.132 INFO:teuthology.orchestra.run.smithi144.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T13:38:11.227 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] help.o 2023-12-19T13:38:11.366 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] init.o 2023-12-19T13:38:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] inode.o 2023-12-19T13:38:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] input.o 2023-12-19T13:38:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] io.o 2023-12-19T13:38:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] logformat.o 2023-12-19T13:38:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] malloc.o 2023-12-19T13:38:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] metadump.o 2023-12-19T13:38:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] output.o 2023-12-19T13:38:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] print.o 2023-12-19T13:38:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] quit.o 2023-12-19T13:38:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] sb.o 2023-12-19T13:38:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] sig.o 2023-12-19T13:38:14.339 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] strvec.o 2023-12-19T13:38:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] text.o 2023-12-19T13:38:14.625 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] type.o 2023-12-19T13:38:14.791 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] write.o 2023-12-19T13:38:15.082 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attrset.o 2023-12-19T13:38:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] symlink.o 2023-12-19T13:38:15.387 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsmap.o 2023-12-19T13:38:15.552 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fuzz.o 2023-12-19T13:38:15.759 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] obfuscate.o 2023-12-19T13:38:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] btdump.o 2023-12-19T13:38:16.170 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] btheight.o 2023-12-19T13:38:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] convert.o 2023-12-19T13:38:16.566 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] info.o 2023-12-19T13:38:16.722 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] iunlink.o 2023-12-19T13:38:16.945 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] namei.o 2023-12-19T13:38:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] timelimit.o 2023-12-19T13:38:17.358 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_db 2023-12-19T13:38:17.688 INFO:teuthology.orchestra.run.smithi144.stdout:Building estimate 2023-12-19T13:38:17.765 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_estimate.o 2023-12-19T13:38:17.941 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_estimate 2023-12-19T13:38:18.056 INFO:teuthology.orchestra.run.smithi144.stdout:Building fsck 2023-12-19T13:38:18.066 INFO:teuthology.orchestra.run.smithi144.stdout:Building fsr 2023-12-19T13:38:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_fsr.o 2023-12-19T13:38:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_fsr 2023-12-19T13:38:18.817 INFO:teuthology.orchestra.run.smithi144.stdout:Building growfs 2023-12-19T13:38:18.891 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_growfs.o 2023-12-19T13:38:19.109 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_growfs 2023-12-19T13:38:19.365 INFO:teuthology.orchestra.run.smithi144.stdout:Building io 2023-12-19T13:38:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] init.o 2023-12-19T13:38:21.498 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr.o 2023-12-19T13:38:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bmap.o 2023-12-19T13:38:21.879 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat.o 2023-12-19T13:38:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] crc32cselftest.o 2023-12-19T13:38:22.180 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] cowextsize.o 2023-12-19T13:38:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] encrypt.o 2023-12-19T13:38:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] file.o 2023-12-19T13:38:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] freeze.o 2023-12-19T13:38:22.810 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsuuid.o 2023-12-19T13:38:22.941 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsync.o 2023-12-19T13:38:23.039 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] getrusage.o 2023-12-19T13:38:23.156 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] imap.o 2023-12-19T13:38:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] inject.o 2023-12-19T13:38:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] label.o 2023-12-19T13:38:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] link.o 2023-12-19T13:38:23.636 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmap.o 2023-12-19T13:38:23.878 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] open.o 2023-12-19T13:38:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] parent.o 2023-12-19T13:38:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] pread.o 2023-12-19T13:38:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] prealloc.o 2023-12-19T13:38:24.758 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] pwrite.o 2023-12-19T13:38:24.945 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] reflink.o 2023-12-19T13:38:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] resblks.o 2023-12-19T13:38:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] scrub.o 2023-12-19T13:38:25.369 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] seek.o 2023-12-19T13:38:25.501 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] shutdown.o 2023-12-19T13:38:25.605 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] stat.o 2023-12-19T13:38:25.832 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] swapext.o 2023-12-19T13:38:25.943 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] sync.o 2023-12-19T13:38:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] truncate.o 2023-12-19T13:38:26.146 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] utimes.o 2023-12-19T13:38:26.252 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fadvise.o 2023-12-19T13:38:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] madvise.o 2023-12-19T13:38:26.478 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mincore.o 2023-12-19T13:38:26.591 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] sendfile.o 2023-12-19T13:38:26.716 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fiemap.o 2023-12-19T13:38:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] copy_file_range.o 2023-12-19T13:38:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] sync_file_range.o 2023-12-19T13:38:27.134 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] readdir.o 2023-12-19T13:38:27.259 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_writes.o 2023-12-19T13:38:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsmap.o 2023-12-19T13:38:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_io 2023-12-19T13:38:27.898 INFO:teuthology.orchestra.run.smithi144.stdout:Building logprint 2023-12-19T13:38:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] logprint.o 2023-12-19T13:38:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_copy.o 2023-12-19T13:38:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_dump.o 2023-12-19T13:38:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_misc.o 2023-12-19T13:38:29.295 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_print_all.o 2023-12-19T13:38:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_print_trans.o 2023-12-19T13:38:29.728 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] log_redo.o 2023-12-19T13:38:30.025 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_logprint 2023-12-19T13:38:30.289 INFO:teuthology.orchestra.run.smithi144.stdout:Building mkfs 2023-12-19T13:38:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] proto.o 2023-12-19T13:38:30.743 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_mkfs.o 2023-12-19T13:38:31.497 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] mkfs.xfs 2023-12-19T13:38:31.746 INFO:teuthology.orchestra.run.smithi144.stdout:Building quota 2023-12-19T13:38:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] init.o 2023-12-19T13:38:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] util.o 2023-12-19T13:38:32.622 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] edit.o 2023-12-19T13:38:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] free.o 2023-12-19T13:38:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] linux.o 2023-12-19T13:38:33.126 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] path.o 2023-12-19T13:38:33.259 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] project.o 2023-12-19T13:38:33.424 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] quot.o 2023-12-19T13:38:33.610 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] quota.o 2023-12-19T13:38:33.806 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] report.o 2023-12-19T13:38:34.065 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] state.o 2023-12-19T13:38:34.275 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_quota 2023-12-19T13:38:34.474 INFO:teuthology.orchestra.run.smithi144.stdout:Building mdrestore 2023-12-19T13:38:34.554 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_mdrestore.o 2023-12-19T13:38:34.752 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_mdrestore 2023-12-19T13:38:34.977 INFO:teuthology.orchestra.run.smithi144.stdout:Building repair 2023-12-19T13:38:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] agheader.o 2023-12-19T13:38:37.136 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] agbtree.o 2023-12-19T13:38:37.423 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr_repair.o 2023-12-19T13:38:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] avl.o 2023-12-19T13:38:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkload.o 2023-12-19T13:38:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bmap.o 2023-12-19T13:38:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] btree.o 2023-12-19T13:38:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] da_util.o 2023-12-19T13:38:39.083 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dino_chunks.o 2023-12-19T13:38:39.516 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dinode.o 2023-12-19T13:38:39.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:39.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:39.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:40.311 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dir2.o 2023-12-19T13:38:40.787 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] globals.o 2023-12-19T13:38:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] incore_bmc.o 2023-12-19T13:38:41.038 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] incore.o 2023-12-19T13:38:41.201 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] incore_ext.o 2023-12-19T13:38:41.440 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] incore_ino.o 2023-12-19T13:38:41.750 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] init.o 2023-12-19T13:38:41.919 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase1.o 2023-12-19T13:38:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase2.o 2023-12-19T13:38:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase3.o 2023-12-19T13:38:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase4.o 2023-12-19T13:38:42.698 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase5.o 2023-12-19T13:38:43.000 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase6.o 2023-12-19T13:38:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase7.o 2023-12-19T13:38:44.056 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] prefetch.o 2023-12-19T13:38:44.418 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] progress.o 2023-12-19T13:38:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] quotacheck.o 2023-12-19T13:38:44.887 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] rmap.o 2023-12-19T13:38:45.325 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] rt.o 2023-12-19T13:38:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] sb.o 2023-12-19T13:38:45.741 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] scan.o 2023-12-19T13:38:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] slab.o 2023-12-19T13:38:46.757 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] threads.o 2023-12-19T13:38:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] versions.o 2023-12-19T13:38:47.039 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_repair.o 2023-12-19T13:38:47.366 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_repair 2023-12-19T13:38:47.684 INFO:teuthology.orchestra.run.smithi144.stdout:Building rtcp 2023-12-19T13:38:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_rtcp.o 2023-12-19T13:38:47.950 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_rtcp 2023-12-19T13:38:48.098 INFO:teuthology.orchestra.run.smithi144.stdout:Building m4 2023-12-19T13:38:48.110 INFO:teuthology.orchestra.run.smithi144.stdout:Building man 2023-12-19T13:38:48.122 INFO:teuthology.orchestra.run.smithi144.stdout:Building man2 2023-12-19T13:38:48.140 INFO:teuthology.orchestra.run.smithi144.stdout:Building man3 2023-12-19T13:38:48.155 INFO:teuthology.orchestra.run.smithi144.stdout:Building man5 2023-12-19T13:38:48.170 INFO:teuthology.orchestra.run.smithi144.stdout:Building man8 2023-12-19T13:38:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: [SED] mkfs.xfs.8 2023-12-19T13:38:48.209 INFO:teuthology.orchestra.run.smithi144.stdout:Building doc 2023-12-19T13:38:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: [ZIP] CHANGES.gz 2023-12-19T13:38:48.241 INFO:teuthology.orchestra.run.smithi144.stdout:Building debian 2023-12-19T13:38:48.251 INFO:teuthology.orchestra.run.smithi144.stdout:Building spaceman 2023-12-19T13:38:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] info.o 2023-12-19T13:38:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] init.o 2023-12-19T13:38:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] file.o 2023-12-19T13:38:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] health.o 2023-12-19T13:38:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] prealloc.o 2023-12-19T13:38:49.429 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] trim.o 2023-12-19T13:38:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] freesp.o 2023-12-19T13:38:49.799 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_spaceman 2023-12-19T13:38:49.984 INFO:teuthology.orchestra.run.smithi144.stdout:Building scrub 2023-12-19T13:38:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] common.o 2023-12-19T13:38:51.191 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] counter.o 2023-12-19T13:38:51.281 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] descr.o 2023-12-19T13:38:51.389 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] disk.o 2023-12-19T13:38:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] filemap.o 2023-12-19T13:38:51.642 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fscounters.o 2023-12-19T13:38:51.769 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] inodes.o 2023-12-19T13:38:51.939 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase1.o 2023-12-19T13:38:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase2.o 2023-12-19T13:38:52.213 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase3.o 2023-12-19T13:38:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase4.o 2023-12-19T13:38:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase5.o 2023-12-19T13:38:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase6.o 2023-12-19T13:38:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] phase7.o 2023-12-19T13:38:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] progress.o 2023-12-19T13:38:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] read_verify.o 2023-12-19T13:38:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] repair.o 2023-12-19T13:38:53.441 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] scrub.o 2023-12-19T13:38:53.690 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] spacemap.o 2023-12-19T13:38:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] vfs.o 2023-12-19T13:38:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfs_scrub.o 2023-12-19T13:38:54.215 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] unicrash.o 2023-12-19T13:38:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] xfs_scrub 2023-12-19T13:38:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: [SED] xfs_scrub_all 2023-12-19T13:38:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: [SED] xfs_scrub@.service 2023-12-19T13:38:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: [SED] xfs_scrub_all.service 2023-12-19T13:38:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: [SED] xfs_scrub_fail@.service 2023-12-19T13:38:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: [SED] xfs_scrub_all.cron 2023-12-19T13:38:54.832 INFO:teuthology.orchestra.run.smithi144.stdout:Building po 2023-12-19T13:38:54.873 INFO:teuthology.orchestra.run.smithi144.stdout: [GETTXT] xfsprogs.pot 2023-12-19T13:38:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: [MSGFMT] de.mo 2023-12-19T13:38:55.175 INFO:teuthology.orchestra.run.smithi144.stderr:2345 translated messages. 2023-12-19T13:38:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: [MSGFMT] pl.mo 2023-12-19T13:38:55.225 INFO:teuthology.orchestra.run.smithi144.stderr:3104 translated messages. 2023-12-19T13:38:55.227 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[2]: Nothing to be done for 'include'. 2023-12-19T13:38:55.234 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.QMOkoB2Hnrxfsprogs-dev && exec sudo make install) 2023-12-19T13:38:55.350 INFO:teuthology.orchestra.run.smithi144.stdout:Installing libfrog-install 2023-12-19T13:38:55.995 INFO:teuthology.orchestra.run.smithi144.stdout:Installing libxfs-install 2023-12-19T13:38:58.365 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-19T13:38:58.396 INFO:teuthology.orchestra.run.smithi144.stdout:Installing libxlog-install 2023-12-19T13:38:58.519 INFO:teuthology.orchestra.run.smithi144.stdout:Installing libxcmd-install 2023-12-19T13:38:58.708 INFO:teuthology.orchestra.run.smithi144.stdout:Installing libhandle-install 2023-12-19T13:38:58.817 INFO:teuthology.orchestra.run.smithi144.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-12-19T13:38:58.939 INFO:teuthology.orchestra.run.smithi144.stdout:Installing copy-install 2023-12-19T13:38:59.005 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:38:59.039 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-12-19T13:38:59.123 INFO:teuthology.orchestra.run.smithi144.stdout:Installing db-install 2023-12-19T13:39:02.056 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:02.088 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-12-19T13:39:02.163 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-12-19T13:39:02.196 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-12-19T13:39:02.230 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-12-19T13:39:02.266 INFO:teuthology.orchestra.run.smithi144.stdout:Installing estimate-install 2023-12-19T13:39:02.338 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:02.370 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-12-19T13:39:02.445 INFO:teuthology.orchestra.run.smithi144.stdout:Installing fsck-install 2023-12-19T13:39:02.449 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T13:39:02.482 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-12-19T13:39:02.519 INFO:teuthology.orchestra.run.smithi144.stdout:Installing fsr-install 2023-12-19T13:39:02.594 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:02.625 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-12-19T13:39:02.697 INFO:teuthology.orchestra.run.smithi144.stdout:Installing growfs-install 2023-12-19T13:39:02.770 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:02.802 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-12-19T13:39:02.878 INFO:teuthology.orchestra.run.smithi144.stdout:Installing io-install 2023-12-19T13:39:04.848 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:04.878 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-12-19T13:39:04.949 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-12-19T13:39:05.016 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-12-19T13:39:05.075 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-12-19T13:39:05.141 INFO:teuthology.orchestra.run.smithi144.stdout:Installing logprint-install 2023-12-19T13:39:05.520 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:05.551 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-12-19T13:39:05.629 INFO:teuthology.orchestra.run.smithi144.stdout:Installing mkfs-install 2023-12-19T13:39:05.755 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T13:39:05.788 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-12-19T13:39:05.868 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-12-19T13:39:05.916 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-12-19T13:39:06.020 INFO:teuthology.orchestra.run.smithi144.stdout:Installing quota-install 2023-12-19T13:39:06.547 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:06.581 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-12-19T13:39:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:Installing mdrestore-install 2023-12-19T13:39:06.724 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:06.754 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-12-19T13:39:06.831 INFO:teuthology.orchestra.run.smithi144.stdout:Installing repair-install 2023-12-19T13:39:08.695 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T13:39:08.726 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-12-19T13:39:08.810 INFO:teuthology.orchestra.run.smithi144.stdout:Installing rtcp-install 2023-12-19T13:39:08.881 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:08.911 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-12-19T13:39:08.978 INFO:teuthology.orchestra.run.smithi144.stdout:Installing m4-install 2023-12-19T13:39:08.981 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T13:39:08.984 INFO:teuthology.orchestra.run.smithi144.stdout:Installing man-install 2023-12-19T13:39:08.994 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-19T13:39:09.002 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-19T13:39:09.013 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-12-19T13:39:09.057 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-12-19T13:39:09.097 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-12-19T13:39:09.138 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-12-19T13:39:09.187 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-12-19T13:39:09.228 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-12-19T13:39:09.266 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-19T13:39:09.307 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-12-19T13:39:09.348 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-12-19T13:39:09.389 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-12-19T13:39:09.430 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-12-19T13:39:09.471 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-12-19T13:39:09.512 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-12-19T13:39:09.553 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-12-19T13:39:09.594 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-12-19T13:39:09.636 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-12-19T13:39:09.678 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-12-19T13:39:09.718 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-12-19T13:39:09.760 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-12-19T13:39:09.802 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-12-19T13:39:09.842 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-12-19T13:39:09.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:09.854 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:09.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:09.884 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-12-19T13:39:09.915 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-12-19T13:39:09.946 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-12-19T13:39:09.979 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-12-19T13:39:10.016 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-12-19T13:39:10.053 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-12-19T13:39:10.089 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-12-19T13:39:10.128 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-19T13:39:10.163 INFO:teuthology.orchestra.run.smithi144.stdout:Installing doc-install 2023-12-19T13:39:10.167 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-19T13:39:10.196 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-12-19T13:39:10.242 INFO:teuthology.orchestra.run.smithi144.stdout:Installing debian-install 2023-12-19T13:39:10.247 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T13:39:10.250 INFO:teuthology.orchestra.run.smithi144.stdout:Installing spaceman-install 2023-12-19T13:39:10.647 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:10.676 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-12-19T13:39:10.746 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-12-19T13:39:10.784 INFO:teuthology.orchestra.run.smithi144.stdout:Installing scrub-install 2023-12-19T13:39:11.809 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T13:39:11.838 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-12-19T13:39:11.905 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-12-19T13:39:11.936 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-12-19T13:39:11.965 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-12-19T13:39:12.023 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-19T13:39:12.054 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-12-19T13:39:12.087 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-19T13:39:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-12-19T13:39:12.153 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/udev/rules.d 2023-12-19T13:39:12.184 INFO:teuthology.orchestra.run.smithi144.stdout:for i in xfs.rules; do \ 2023-12-19T13:39:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: ../install-sh -o root -g root -m 644 $i /usr/lib/udev/rules.d/64-$i; \ 2023-12-19T13:39:12.184 INFO:teuthology.orchestra.run.smithi144.stdout:done 2023-12-19T13:39:12.227 INFO:teuthology.orchestra.run.smithi144.stdout:Installing po-install 2023-12-19T13:39:12.380 INFO:teuthology.orchestra.run.smithi144.stdout:Installing include-install 2023-12-19T13:39:12.383 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-19T13:39:12.415 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-19T13:39:12.446 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-12-19T13:39:12.482 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-12-19T13:39:12.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-19T13:39:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.599+0000 7fcce20bd640 1 Processor -- start 2023-12-19T13:39:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.599+0000 7fcce20bd640 1 -- start start 2023-12-19T13:39:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fcce20bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc06a6d0 0x7fccdc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fcce20bd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccdc0ba550 0x7fccdc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fcce20bd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0bb310 con 0x7fccdc14b1f0 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fcce20bd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0bf960 con 0x7fccdc0ba550 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fcce20bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0bb5b0 con 0x7fccdc06a6d0 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccdc0ba550 0x7fccdc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccdc0ba550 0x7fccdc1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46672/0 (socket says 172.21.15.6:46672) 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdaffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fccdc14b1f0 0x7fccdc0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52382/0 (socket says 172.21.15.6:52382) 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 -- 172.21.15.6:0/426033468 learned_addr learned my addr 172.21.15.6:0/426033468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 -- 172.21.15.6:0/426033468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc06a6d0 msgr2=0x7fccdc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdb7fe640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc06a6d0 0x7fccdc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc06a6d0 0x7fccdc14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 -- 172.21.15.6:0/426033468 >> v1:172.21.15.6:6789/0 conn(0x7fccdc14b1f0 legacy=0x7fccdc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccda7fc640 1 -- 172.21.15.6:0/426033468 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117517808 0 0) 0x7fccdc0bb310 con 0x7fccdc14b1f0 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdbfff640 1 -- 172.21.15.6:0/426033468 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0c0120 con 0x7fccdc0ba550 2023-12-19T13:39:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.600+0000 7fccdb7fe640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc06a6d0 0x7fccdc14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.601+0000 7fccdbfff640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc1554e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009e50 tx=0x7fccd402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60978bf578a624e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.601+0000 7fccda7fc640 1 -- 172.21.15.6:0/426033468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd402cb00 con 0x7fccdc0ba550 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.601+0000 7fccda7fc640 1 -- 172.21.15.6:0/426033468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd402cc60 con 0x7fccdc0ba550 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.601+0000 7fccda7fc640 1 -- 172.21.15.6:0/426033468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40343f0 con 0x7fccdc0ba550 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 -- 172.21.15.6:0/426033468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 msgr2=0x7fccdc1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc1554e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009e50 tx=0x7fccd402bf60 comp rx=0 tx=0).stop 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 -- 172.21.15.6:0/426033468 shutdown_connections 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc1554e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 --2- 172.21.15.6:0/426033468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc06a6d0 0x7fccdc14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 -- 172.21.15.6:0/426033468 >> 172.21.15.6:0/426033468 conn(0x7fccdc0c0350 msgr2=0x7fccdc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:39:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 -- 172.21.15.6:0/426033468 shutdown_connections 2023-12-19T13:39:12.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.602+0000 7fcce20bd640 1 -- 172.21.15.6:0/426033468 wait complete. 2023-12-19T13:39:12.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.603+0000 7fcce20bd640 1 Processor -- start 2023-12-19T13:39:12.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.603+0000 7fcce20bd640 1 -- start start 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fcce20bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccdc06a6d0 0x7fccdc0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fcce20bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fcce20bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc14b1f0 0x7fccdc1e3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fcce20bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b68b0 con 0x7fccdc0ba550 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fcce20bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b6640 con 0x7fccdc06a6d0 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fcce20bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0a4890 con 0x7fccdc14b1f0 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc0b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46682/0 (socket says 172.21.15.6:46682) 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 -- 172.21.15.6:0/2883634039 learned_addr learned my addr 172.21.15.6:0/2883634039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:39:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdb7fe640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccdc06a6d0 0x7fccdc0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdbfff640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc14b1f0 0x7fccdc1e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 -- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc14b1f0 msgr2=0x7fccdc1e3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc14b1f0 0x7fccdc1e3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 -- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccdc06a6d0 msgr2=0x7fccdc0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccdc06a6d0 0x7fccdc0b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 -- 172.21.15.6:0/2883634039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009b30 con 0x7fccdc0ba550 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.604+0000 7fccdaffd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc0b50b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c440 tx=0x7fccd000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:39:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.605+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00074e0 con 0x7fccdc0ba550 2023-12-19T13:39:12.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.605+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0007640 con 0x7fccdc0ba550 2023-12-19T13:39:12.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.605+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc0b48f0 con 0x7fccdc0ba550 2023-12-19T13:39:12.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.605+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0004a20 con 0x7fccdc0ba550 2023-12-19T13:39:12.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.605+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc0b4b90 con 0x7fccdc0ba550 2023-12-19T13:39:12.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.606+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc09a0b0 con 0x7fccdc0ba550 2023-12-19T13:39:12.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.606+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fccd0004b80 con 0x7fccdc0ba550 2023-12-19T13:39:12.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.606+0000 7fccc3fff640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fccc806a460 0x7fccc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.607+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccd00879f0 con 0x7fccdc0ba550 2023-12-19T13:39:12.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.607+0000 7fccdb7fe640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fccc806a460 0x7fccc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.607+0000 7fccdb7fe640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fccc806a460 0x7fccc806c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00ab60 tx=0x7fcccc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:39:12.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.611+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fccd0053090 con 0x7fccdc0ba550 2023-12-19T13:39:12.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.857+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fccdc073a40 con 0x7fccdc0ba550 2023-12-19T13:39:12.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.857+0000 7fccc3fff640 1 -- 172.21.15.6:0/2883634039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1264 (secure 0 0 0) 0x7fccd0018070 con 0x7fccdc0ba550 2023-12-19T13:39:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T13:39:12.858 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","modified":"2023-12-19T13:32:09.568751Z","created":"2023-12-19T13:32:09.568751Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3301","nonce":0},{"type":"v1","addr":"172.21.15.89:6790","nonce":0}]},"addr":"172.21.15.89:6790/0","public_addr":"172.21.15.89:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-19T13:39:12.859 INFO:teuthology.orchestra.run.smithi006.stderr:dumped monmap epoch 1 2023-12-19T13:39:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fccc806a460 msgr2=0x7fccc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fccc806a460 0x7fccc806c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00ab60 tx=0x7fcccc008040 comp rx=0 tx=0).stop 2023-12-19T13:39:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 msgr2=0x7fccdc0b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc0b50b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c440 tx=0x7fccd000c900 comp rx=0 tx=0).stop 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 shutdown_connections 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fccc806a460 0x7fccc806c920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccdc14b1f0 0x7fccdc1e3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccdc0ba550 0x7fccdc0b50b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 --2- 172.21.15.6:0/2883634039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccdc06a6d0 0x7fccdc0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 >> 172.21.15.6:0/2883634039 conn(0x7fccdc0c0350 msgr2=0x7fccdc0a1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 shutdown_connections 2023-12-19T13:39:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.859+0000 7fcce20bd640 1 -- 172.21.15.6:0/2883634039 wait complete. 2023-12-19T13:39:12.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-19T13:39:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.977+0000 7f5e5143e640 1 Processor -- start 2023-12-19T13:39:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.977+0000 7f5e5143e640 1 -- start start 2023-12-19T13:39:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e5143e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e4c06bdb0 0x7f5e4c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e5143e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c06eae0 con 0x7f5e4c06b9d0 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e5143e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c06e6c0 con 0x7f5e4c153480 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e5143e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c06cee0 con 0x7f5e4c06bdb0 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e4affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5e4c06b9d0 0x7f5e4c06ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52394/0 (socket says 172.21.15.6:52394) 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e4affd640 1 -- 172.21.15.6:0/604885580 learned_addr learned my addr 172.21.15.6:0/604885580 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017644356 0 0) 0x7f5e4c06eae0 con 0x7f5e4c06b9d0 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e4a7fc640 1 --2- 172.21.15.6:0/604885580 >> v2:172.21.15.89:3300/0 conn(0x7f5e4c06bdb0 0x7f5e4c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e34003520 con 0x7f5e4c06b9d0 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3672401928 0 0) 0x7f5e34003520 con 0x7f5e4c06b9d0 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 >> v2:172.21.15.89:3300/0 conn(0x7f5e4c06bdb0 msgr2=0x7f5e4c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e49ffb640 1 --2- 172.21.15.6:0/604885580 >> v2:172.21.15.89:3300/0 conn(0x7f5e4c06bdb0 0x7f5e4c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.978+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 >> v1:172.21.15.89:6789/0 conn(0x7f5e4c153480 legacy=0x7f5e4c155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c06af90 con 0x7f5e4c06b9d0 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f5e44001670 con 0x7f5e4c06b9d0 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 >> v1:172.21.15.6:6789/0 conn(0x7f5e4c06b9d0 legacy=0x7f5e4c06ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e34003970 0x7f5e34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e340047c0 0x7f5e34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34005180 0x7f5e3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c06cee0 con 0x7f5e34003970 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3400c020 con 0x7f5e34005180 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3400c1e0 con 0x7f5e340047c0 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4affd640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e34003970 0x7f5e34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4a7fc640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e340047c0 0x7f5e34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4b7fe640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34005180 0x7f5e3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4affd640 1 -- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e340047c0 msgr2=0x7f5e34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4affd640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e340047c0 0x7f5e34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4affd640 1 -- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34005180 msgr2=0x7f5e3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4affd640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34005180 0x7f5e3400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4affd640 1 -- 172.21.15.6:0/604885580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34003520 con 0x7f5e34003970 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4b7fe640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34005180 0x7f5e3400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.979+0000 7f5e4b7fe640 1 -- 172.21.15.6:0/604885580 reap_dead start 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e4affd640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e34003970 0x7f5e34003d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400c240 tx=0x7f5e340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499f899d6b8ab225 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44005ad0 con 0x7f5e34003970 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44005c30 con 0x7f5e34003970 2023-12-19T13:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e49ffb640 1 -- 172.21.15.6:0/604885580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4402caf0 con 0x7f5e34003970 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e5143e640 1 -- 172.21.15.6:0/604885580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e34003970 msgr2=0x7f5e34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e5143e640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e34003970 0x7f5e34003d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400c240 tx=0x7f5e340057f0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e5143e640 1 -- 172.21.15.6:0/604885580 shutdown_connections 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e5143e640 1 --2- 172.21.15.6:0/604885580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e34003970 0x7f5e34003d90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.980+0000 7f5e5143e640 1 -- 172.21.15.6:0/604885580 >> 172.21.15.6:0/604885580 conn(0x7f5e4c0be1e0 msgr2=0x7f5e4c0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.981+0000 7f5e5143e640 1 -- 172.21.15.6:0/604885580 shutdown_connections 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.981+0000 7f5e5143e640 1 -- 172.21.15.6:0/604885580 wait complete. 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 Processor -- start 2023-12-19T13:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 -- start start 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34003970 0x7f5e4c1416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 0x7f5e4c147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e4c148220 0x7f5e4c0a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c144c50 con 0x7f5e4c146cb0 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c141bf0 con 0x7f5e34003970 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e5143e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c145b30 con 0x7f5e4c148220 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e4a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 0x7f5e4c147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e4a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 0x7f5e4c147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46688/0 (socket says 172.21.15.6:46688) 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.982+0000 7f5e4a7fc640 1 -- 172.21.15.6:0/3890003911 learned_addr learned my addr 172.21.15.6:0/3890003911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4affd640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34003970 0x7f5e4c1416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4b7fe640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e4c148220 0x7f5e4c0a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4a7fc640 1 -- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e4c148220 msgr2=0x7f5e4c0a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4a7fc640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e4c148220 0x7f5e4c0a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4a7fc640 1 -- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34003970 msgr2=0x7f5e4c1416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4a7fc640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34003970 0x7f5e4c1416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4a7fc640 1 -- 172.21.15.6:0/3890003911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c1e38a0 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4affd640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34003970 0x7f5e4c1416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e4a7fc640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 0x7f5e4c147ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e40011ad0 tx=0x7f5e40011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40009680 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000fbb0 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c145d80 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40014440 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.983+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c1474e0 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.984+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c066e90 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.984+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e4001d400 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.985+0000 7f5e337fe640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e3806a430 0x7f5e3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.985+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e40089160 con 0x7f5e4c146cb0 2023-12-19T13:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.985+0000 7f5e4affd640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e3806a430 0x7f5e3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T13:39:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.986+0000 7f5e4affd640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e3806a430 0x7f5e3806c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e44034000 tx=0x7f5e44009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T13:39:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:12.989+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e400547e0 con 0x7f5e4c146cb0 2023-12-19T13:39:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.234+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f5e4c073a40 con 0x7f5e4c146cb0 2023-12-19T13:39:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.234+0000 7f5e337fe640 1 -- 172.21.15.6:0/3890003911 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f5e40057e00 con 0x7f5e4c146cb0 2023-12-19T13:39:13.235 INFO:teuthology.orchestra.run.smithi006.stdout:[client.admin] 2023-12-19T13:39:13.235 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg== 2023-12-19T13:39:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e3806a430 msgr2=0x7f5e3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e3806a430 0x7f5e3806c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e44034000 tx=0x7f5e44009030 comp rx=0 tx=0).stop 2023-12-19T13:39:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 msgr2=0x7f5e4c147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T13:39:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 0x7f5e4c147ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e40011ad0 tx=0x7f5e40011f90 comp rx=0 tx=0).stop 2023-12-19T13:39:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 shutdown_connections 2023-12-19T13:39:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5e3806a430 0x7f5e3806c8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e4c148220 0x7f5e4c0a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e4c146cb0 0x7f5e4c147ce0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 --2- 172.21.15.6:0/3890003911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e34003970 0x7f5e4c1416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T13:39:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 >> 172.21.15.6:0/3890003911 conn(0x7f5e4c0be1e0 msgr2=0x7f5e4c06c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T13:39:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 shutdown_connections 2023-12-19T13:39:13.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T13:39:13.236+0000 7f5e5143e640 1 -- 172.21.15.6:0/3890003911 wait complete. 2023-12-19T13:39:13.247 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T13:39:13.247 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/tmp/tmp.nnuPRzScSZxfstests-dev/local.config 2023-12-19T13:39:13.352 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.6:6789:/test export TEST_DIR=/tmp/tmp.2JNDlqAT3Etest export SCRATCH_DEV=172.21.15.6:6789:/scratch export SCRATCH_MNT=/tmp/tmp.Ca1ESYblXHscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg==,test_dummy_encryption" 2023-12-19T13:39:13.352 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-12-19T13:39:13.352 DEBUG:teuthology.orchestra.run.smithi144:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.nnuPRzScSZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-12-19T13:39:16.125 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-12-19T13:39:16.142 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-19T13:39:16.143 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-12-19T13:39:16.149 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.Ca1ESYblXHscratch 2023-12-19T13:39:16.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T13:39:16.346 INFO:teuthology.orchestra.run.smithi144.stdout:ceph/001 [expunged] 2023-12-19T13:39:16.840 INFO:teuthology.orchestra.run.smithi144.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T13:39:17.360 INFO:teuthology.orchestra.run.smithi144.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T13:39:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:ceph/004 0s 2023-12-19T13:39:18.407 INFO:teuthology.orchestra.run.smithi144.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T13:39:28.588 INFO:teuthology.orchestra.run.smithi144.stdout:generic/001 10s 2023-12-19T13:39:29.482 INFO:teuthology.orchestra.run.smithi144.stdout:generic/002 1s 2023-12-19T13:39:29.954 INFO:teuthology.orchestra.run.smithi144.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-19T13:39:30.420 INFO:teuthology.orchestra.run.smithi144.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-19T13:39:31.263 INFO:teuthology.orchestra.run.smithi144.stdout:generic/005 1s 2023-12-19T13:39:39.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:39.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:39.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:54.591 INFO:teuthology.orchestra.run.smithi144.stdout:generic/006 23s 2023-12-19T13:40:10.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:10.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:10.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:40.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:40.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:40.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:40.778 INFO:teuthology.orchestra.run.smithi144.stdout:generic/007 46s 2023-12-19T13:40:42.972 INFO:teuthology.orchestra.run.smithi144.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T13:40:45.138 INFO:teuthology.orchestra.run.smithi144.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T13:41:10.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:10.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:10.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:12.908 INFO:teuthology.orchestra.run.smithi144.stdout:generic/011 27s 2023-12-19T13:41:15.508 INFO:teuthology.orchestra.run.smithi144.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:41:40.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:40.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:40.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:48.387 INFO:teuthology.orchestra.run.smithi144.stdout:generic/013 33s 2023-12-19T13:42:11.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:11.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:11.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:41.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:41.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:41.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:11.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:11.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:11.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:41.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:41.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:41.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:09.466 INFO:teuthology.orchestra.run.smithi144.stdout:generic/014 141s 2023-12-19T13:44:09.910 INFO:teuthology.orchestra.run.smithi144.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T13:44:11.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:11.935 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:11.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:14.731 INFO:teuthology.orchestra.run.smithi144.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:44:15.345 INFO:teuthology.orchestra.run.smithi144.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-19T13:44:27.915 INFO:teuthology.orchestra.run.smithi144.stdout:generic/020 12s 2023-12-19T13:44:32.005 INFO:teuthology.orchestra.run.smithi144.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:44:37.111 INFO:teuthology.orchestra.run.smithi144.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:44:39.046 INFO:teuthology.orchestra.run.smithi144.stdout:generic/023 2s 2023-12-19T13:44:39.510 INFO:teuthology.orchestra.run.smithi144.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-19T13:44:39.994 INFO:teuthology.orchestra.run.smithi144.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-19T13:44:40.467 INFO:teuthology.orchestra.run.smithi144.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-19T13:44:42.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:42.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:42.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:42.121 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T13:44:42.120+0000 7f3e2e3ec640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101123) UID: 0 2023-12-19T13:44:42.121 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-12-19T13:44:42.120+0000 7ff1fa279640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101123) UID: 0 2023-12-19T13:44:45.975 INFO:teuthology.orchestra.run.smithi144.stdout:generic/028 5s 2023-12-19T13:44:47.278 INFO:teuthology.orchestra.run.smithi144.stdout:generic/029 2s 2023-12-19T13:44:52.619 INFO:teuthology.orchestra.run.smithi144.stdout:generic/030 5s 2023-12-19T13:44:58.543 INFO:teuthology.orchestra.run.smithi144.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-19T13:44:59.022 INFO:teuthology.orchestra.run.smithi144.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T13:45:04.346 INFO:teuthology.orchestra.run.smithi144.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T13:45:04.849 INFO:teuthology.orchestra.run.smithi144.stdout:generic/034 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:05.412 INFO:teuthology.orchestra.run.smithi144.stdout:generic/035 1s 2023-12-19T13:45:12.663 INFO:teuthology.orchestra.run.smithi144.stdout:generic/037 7s 2023-12-19T13:45:13.198 INFO:teuthology.orchestra.run.smithi144.stdout:generic/039 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:13.683 INFO:teuthology.orchestra.run.smithi144.stdout:generic/040 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:14.179 INFO:teuthology.orchestra.run.smithi144.stdout:generic/041 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:14.825 INFO:teuthology.orchestra.run.smithi144.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-19T13:45:15.472 INFO:teuthology.orchestra.run.smithi144.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-19T13:45:16.119 INFO:teuthology.orchestra.run.smithi144.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-19T13:45:17.321 INFO:teuthology.orchestra.run.smithi144.stdout:generic/053 1s 2023-12-19T13:45:17.898 INFO:teuthology.orchestra.run.smithi144.stdout:generic/056 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:18.410 INFO:teuthology.orchestra.run.smithi144.stdout:generic/057 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:45:23.496 INFO:teuthology.orchestra.run.smithi144.stdout:generic/059 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:28.599 INFO:teuthology.orchestra.run.smithi144.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:45:32.000 INFO:teuthology.orchestra.run.smithi144.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:45:34.506 INFO:teuthology.orchestra.run.smithi144.stdout:generic/062 2s 2023-12-19T13:45:40.192 INFO:teuthology.orchestra.run.smithi144.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T13:45:40.708 INFO:teuthology.orchestra.run.smithi144.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T13:45:41.221 INFO:teuthology.orchestra.run.smithi144.stdout:generic/065 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:41.696 INFO:teuthology.orchestra.run.smithi144.stdout:generic/066 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:45:42.211 INFO:teuthology.orchestra.run.smithi144.stdout:generic/067 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:46:03.037 INFO:teuthology.orchestra.run.smithi144.stdout:generic/069 21s 2023-12-19T13:46:21.017 INFO:teuthology.orchestra.run.smithi144.stdout:generic/070 18s 2023-12-19T13:46:21.480 INFO:teuthology.orchestra.run.smithi144.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T13:46:21.957 INFO:teuthology.orchestra.run.smithi144.stdout:generic/073 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:46:41.628 INFO:teuthology.orchestra.run.smithi144.stdout:generic/075 20s 2023-12-19T13:46:42.069 INFO:teuthology.orchestra.run.smithi144.stdout:generic/076 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-12-19T13:46:42.540 INFO:teuthology.orchestra.run.smithi144.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-19T13:46:43.017 INFO:teuthology.orchestra.run.smithi144.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-19T13:46:45.559 INFO:teuthology.orchestra.run.smithi144.stdout:generic/080 2s 2023-12-19T13:46:46.093 INFO:teuthology.orchestra.run.smithi144.stdout:generic/081 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:46:46.573 INFO:teuthology.orchestra.run.smithi144.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T13:46:52.589 INFO:teuthology.orchestra.run.smithi144.stdout:generic/084 6s 2023-12-19T13:46:53.114 INFO:teuthology.orchestra.run.smithi144.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T13:46:53.721 INFO:teuthology.orchestra.run.smithi144.stdout:generic/087 0s 2023-12-19T13:46:54.222 INFO:teuthology.orchestra.run.smithi144.stdout:generic/088 1s 2023-12-19T13:46:54.674 INFO:teuthology.orchestra.run.smithi144.stdout:generic/090 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:47:23.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:23.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:23.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:53.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:53.750 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:53.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:05.255 INFO:teuthology.orchestra.run.smithi144.stdout:generic/091 71s 2023-12-19T13:48:05.738 INFO:teuthology.orchestra.run.smithi144.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T13:48:06.282 INFO:teuthology.orchestra.run.smithi144.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T13:48:13.034 INFO:teuthology.orchestra.run.smithi144.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T13:48:13.872 INFO:teuthology.orchestra.run.smithi144.stdout:generic/097 0s 2023-12-19T13:48:15.031 INFO:teuthology.orchestra.run.smithi144.stdout:generic/098 2s 2023-12-19T13:48:16.684 INFO:teuthology.orchestra.run.smithi144.stdout:generic/099 1s 2023-12-19T13:48:17.157 INFO:teuthology.orchestra.run.smithi144.stdout:generic/101 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:48:17.643 INFO:teuthology.orchestra.run.smithi144.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T13:48:18.186 INFO:teuthology.orchestra.run.smithi144.stdout:generic/104 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:48:19.187 INFO:teuthology.orchestra.run.smithi144.stdout:generic/105 1s 2023-12-19T13:48:19.782 INFO:teuthology.orchestra.run.smithi144.stdout:generic/106 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:48:20.297 INFO:teuthology.orchestra.run.smithi144.stdout:generic/107 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:48:20.928 INFO:teuthology.orchestra.run.smithi144.stdout:generic/108 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T13:48:21.427 INFO:teuthology.orchestra.run.smithi144.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T13:48:21.953 INFO:teuthology.orchestra.run.smithi144.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T13:48:23.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:23.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:23.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:48.102 INFO:teuthology.orchestra.run.smithi144.stdout:generic/112 27s 2023-12-19T13:48:54.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:54.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:54.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:24.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:24.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:24.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:54.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:54.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:54.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:24.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:24.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:24.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:51.818 INFO:teuthology.orchestra.run.smithi144.stdout:generic/113 123s 2023-12-19T13:50:52.309 INFO:teuthology.orchestra.run.smithi144.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-19T13:50:52.848 INFO:teuthology.orchestra.run.smithi144.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T13:50:53.367 INFO:teuthology.orchestra.run.smithi144.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T13:50:54.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:54.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:54.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:00.863 INFO:teuthology.orchestra.run.smithi144.stdout:generic/117 7s 2023-12-19T13:51:01.454 INFO:teuthology.orchestra.run.smithi144.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T13:51:01.998 INFO:teuthology.orchestra.run.smithi144.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T13:51:02.456 INFO:teuthology.orchestra.run.smithi144.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-19T13:51:02.974 INFO:teuthology.orchestra.run.smithi144.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T13:51:03.518 INFO:teuthology.orchestra.run.smithi144.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T13:51:04.678 INFO:teuthology.orchestra.run.smithi144.stdout:generic/123 1s 2023-12-19T13:51:24.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:24.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:24.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:36.541 INFO:teuthology.orchestra.run.smithi144.stdout:generic/124 32s 2023-12-19T13:51:37.339 INFO:teuthology.orchestra.run.smithi144.stdout:generic/126 1s 2023-12-19T13:51:48.838 INFO:teuthology.orchestra.run.smithi144.stdout:generic/128 11s 2023-12-19T13:51:55.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:55.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:55.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:25.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:25.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:25.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:55.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:55.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:55.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:26.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:26.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:26.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:56.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:56.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:56.689 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:26.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:26.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:26.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:57.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:57.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:57.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:27.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:27.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:27.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:57.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:57.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:57.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:27.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:27.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:27.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:57.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:57.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:57.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:27.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:27.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:27.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:58.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:58.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:58.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:28.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:28.559 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:28.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:58.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:58.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:58.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:28.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:28.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:28.877 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:59.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:59.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:59.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:29.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:29.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:29.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:59.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:59.490 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:59.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:29.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:59.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:59.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:59.781 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:29.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:29.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:29.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:00.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:00.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:00.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:30.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:30.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:30.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:00.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:00.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:00.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:30.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:30.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:30.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:01.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:01.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:01.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:31.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:31.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:31.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:01.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:01.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:01.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:31.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:31.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:31.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:01.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:01.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:01.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:32.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:32.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:32.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:02.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:02.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:02.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:32.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:32.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:32.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:02.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:03.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:03.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:33.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:33.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:33.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:03.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:03.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:03.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:34.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:34.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:34.190 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:04.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:04.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:04.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:34.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:34.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:34.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:05.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:05.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:05.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:35.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:35.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:35.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:35.796 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T14:12:35.795+0000 7fb96e43e640 -1 Fail to open '/proc/96932/cmdline' error = (2) No such file or directory 2023-12-19T14:12:35.796 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T14:12:35.795+0000 7fb96e43e640 -1 received signal: Hangup from (PID: 96932) UID: 0 2023-12-19T14:12:35.816 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T14:12:35.794+0000 7effdbaee640 -1 Fail to open '/proc/96932/cmdline' error = (2) No such file or directory 2023-12-19T14:12:35.816 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T14:12:35.795+0000 7f8efc5ae640 -1 Fail to open '/proc/96932/cmdline' error = (2) No such file or directory 2023-12-19T14:12:35.816 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T14:12:35.795+0000 7f8efc5ae640 -1 received signal: Hangup from (PID: 96932) UID: 0 2023-12-19T14:12:35.817 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T14:12:35.794+0000 7effdbaee640 -1 received signal: Hangup from (PID: 96932) UID: 0 2023-12-19T14:12:35.826 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T14:12:35.799+0000 7f95e3e8a640 -1 Fail to open '/proc/96932/cmdline' error = (2) No such file or directory 2023-12-19T14:12:35.827 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T14:12:35.799+0000 7f95e3e8a640 -1 received signal: Hangup from (PID: 96932) UID: 0 2023-12-19T14:13:46.958 INFO:teuthology.orchestra.run.smithi144.stdout:generic/129 1318s 2023-12-19T14:14:02.920 INFO:teuthology.orchestra.run.smithi144.stdout:generic/130 16s 2023-12-19T14:14:04.665 INFO:teuthology.orchestra.run.smithi144.stdout:generic/131 2s 2023-12-19T14:14:05.167 INFO:teuthology.orchestra.run.smithi144.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:06.960 INFO:teuthology.orchestra.run.smithi144.stdout:generic/135 1s 2023-12-19T14:14:07.546 INFO:teuthology.orchestra.run.smithi144.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T14:14:08.047 INFO:teuthology.orchestra.run.smithi144.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:08.551 INFO:teuthology.orchestra.run.smithi144.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:09.082 INFO:teuthology.orchestra.run.smithi144.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:10.952 INFO:teuthology.orchestra.run.smithi144.stdout:generic/141 1s 2023-12-19T14:14:11.537 INFO:teuthology.orchestra.run.smithi144.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:12.056 INFO:teuthology.orchestra.run.smithi144.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:12.553 INFO:teuthology.orchestra.run.smithi144.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:13.069 INFO:teuthology.orchestra.run.smithi144.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:13.597 INFO:teuthology.orchestra.run.smithi144.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:14.116 INFO:teuthology.orchestra.run.smithi144.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:14.631 INFO:teuthology.orchestra.run.smithi144.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:15.175 INFO:teuthology.orchestra.run.smithi144.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:15.737 INFO:teuthology.orchestra.run.smithi144.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:16.259 INFO:teuthology.orchestra.run.smithi144.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:16.796 INFO:teuthology.orchestra.run.smithi144.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:17.331 INFO:teuthology.orchestra.run.smithi144.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:17.855 INFO:teuthology.orchestra.run.smithi144.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:18.390 INFO:teuthology.orchestra.run.smithi144.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:18.892 INFO:teuthology.orchestra.run.smithi144.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:19.434 INFO:teuthology.orchestra.run.smithi144.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:19.947 INFO:teuthology.orchestra.run.smithi144.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T14:14:20.406 INFO:teuthology.orchestra.run.smithi144.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-19T14:14:20.877 INFO:teuthology.orchestra.run.smithi144.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-19T14:14:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:22.352 INFO:teuthology.orchestra.run.smithi144.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T14:14:23.168 INFO:teuthology.orchestra.run.smithi144.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T14:14:24.711 INFO:teuthology.orchestra.run.smithi144.stdout:generic/169 1s 2023-12-19T14:14:25.564 INFO:teuthology.orchestra.run.smithi144.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:26.326 INFO:teuthology.orchestra.run.smithi144.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi144.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:27.949 INFO:teuthology.orchestra.run.smithi144.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:38.495 INFO:teuthology.orchestra.run.smithi144.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:14:39.012 INFO:teuthology.orchestra.run.smithi144.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:39.551 INFO:teuthology.orchestra.run.smithi144.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:40.068 INFO:teuthology.orchestra.run.smithi144.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:40.588 INFO:teuthology.orchestra.run.smithi144.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:14:41.112 INFO:teuthology.orchestra.run.smithi144.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T14:14:41.946 INFO:teuthology.orchestra.run.smithi144.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:42.489 INFO:teuthology.orchestra.run.smithi144.stdout:generic/184 1s 2023-12-19T14:14:43.295 INFO:teuthology.orchestra.run.smithi144.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:44.095 INFO:teuthology.orchestra.run.smithi144.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:44.868 INFO:teuthology.orchestra.run.smithi144.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:45.658 INFO:teuthology.orchestra.run.smithi144.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:46.486 INFO:teuthology.orchestra.run.smithi144.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:48.575 INFO:teuthology.orchestra.run.smithi144.stdout:generic/193 2s 2023-12-19T14:14:49.344 INFO:teuthology.orchestra.run.smithi144.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:50.140 INFO:teuthology.orchestra.run.smithi144.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:50.909 INFO:teuthology.orchestra.run.smithi144.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:14:51.663 INFO:teuthology.orchestra.run.smithi144.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:20.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:20.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:20.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:27.238 INFO:teuthology.orchestra.run.smithi144.stdout:generic/198 36s 2023-12-19T14:15:27.954 INFO:teuthology.orchestra.run.smithi144.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:28.713 INFO:teuthology.orchestra.run.smithi144.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:29.491 INFO:teuthology.orchestra.run.smithi144.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:30.282 INFO:teuthology.orchestra.run.smithi144.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:31.882 INFO:teuthology.orchestra.run.smithi144.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:32.726 INFO:teuthology.orchestra.run.smithi144.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:50.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:50.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:50.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:50.961 INFO:teuthology.orchestra.run.smithi144.stdout:generic/207 18s 2023-12-19T14:15:51.498 INFO:teuthology.orchestra.run.smithi144.stdout:generic/210 1s 2023-12-19T14:15:52.520 INFO:teuthology.orchestra.run.smithi144.stdout:generic/211 1s 2023-12-19T14:15:53.093 INFO:teuthology.orchestra.run.smithi144.stdout:generic/212 1s 2023-12-19T14:15:53.588 INFO:teuthology.orchestra.run.smithi144.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:15:54.087 INFO:teuthology.orchestra.run.smithi144.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:15:56.628 INFO:teuthology.orchestra.run.smithi144.stdout:generic/215 2s 2023-12-19T14:15:57.433 INFO:teuthology.orchestra.run.smithi144.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:58.218 INFO:teuthology.orchestra.run.smithi144.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:59.008 INFO:teuthology.orchestra.run.smithi144.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:15:59.472 INFO:teuthology.orchestra.run.smithi144.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:16:00.265 INFO:teuthology.orchestra.run.smithi144.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:16:01.767 INFO:teuthology.orchestra.run.smithi144.stdout:generic/221 1s 2023-12-19T14:16:02.517 INFO:teuthology.orchestra.run.smithi144.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:16:02.978 INFO:teuthology.orchestra.run.smithi144.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:16:03.525 INFO:teuthology.orchestra.run.smithi144.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T14:16:04.381 INFO:teuthology.orchestra.run.smithi144.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:16:04.879 INFO:teuthology.orchestra.run.smithi144.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:16:05.652 INFO:teuthology.orchestra.run.smithi144.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:16:06.134 INFO:teuthology.orchestra.run.smithi144.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:16:06.605 INFO:teuthology.orchestra.run.smithi144.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:16:08.140 INFO:teuthology.orchestra.run.smithi144.stdout:generic/236 2s 2023-12-19T14:16:08.717 INFO:teuthology.orchestra.run.smithi144.stdout:generic/237 0s 2023-12-19T14:16:09.487 INFO:teuthology.orchestra.run.smithi144.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:16:21.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:21.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:21.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:21.997 INFO:teuthology.orchestra.run.smithi144.stdout:generic/240 12s 2023-12-19T14:16:22.428 INFO:teuthology.orchestra.run.smithi144.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:16:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:generic/245 0s 2023-12-19T14:16:23.480 INFO:teuthology.orchestra.run.smithi144.stdout:generic/246 0s 2023-12-19T14:16:51.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:51.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:51.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:21.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:21.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:21.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:51.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:51.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:51.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:51.945 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T14:17:51.944+0000 7f563af75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102213) UID: 0 2023-12-19T14:17:51.945 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T14:17:51.945+0000 7f97252d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102213) UID: 0 2023-12-19T14:17:51.946 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T14:17:51.945+0000 7fdb555bd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102213) UID: 0 2023-12-19T14:17:51.953 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T14:17:51.945+0000 7f27baa19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102213) UID: 0 2023-12-19T14:20:46.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:46.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:46.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:46.734 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T14:20:46.732+0000 7f8efc5ae640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97072) UID: 0 2023-12-19T14:20:46.734 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T14:20:46.732+0000 7fb96e43e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97072) UID: 0 2023-12-19T14:20:46.734 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T14:20:46.732+0000 7f95e3e8a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97072) UID: 0 2023-12-19T14:20:46.735 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T14:20:46.732+0000 7effdbaee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97072) UID: 0 2023-12-19T14:21:43.646 INFO:teuthology.orchestra.run.smithi144.stdout:generic/247 320s 2023-12-19T14:21:44.203 INFO:teuthology.orchestra.run.smithi144.stdout:generic/248 1s 2023-12-19T14:22:09.817 INFO:teuthology.orchestra.run.smithi144.stdout:generic/249 25s 2023-12-19T14:22:10.344 INFO:teuthology.orchestra.run.smithi144.stdout:generic/250 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:22:10.824 INFO:teuthology.orchestra.run.smithi144.stdout:generic/252 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:22:11.631 INFO:teuthology.orchestra.run.smithi144.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:22:12.408 INFO:teuthology.orchestra.run.smithi144.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:22:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:22:33.276 INFO:teuthology.orchestra.run.smithi144.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:22:34.549 INFO:teuthology.orchestra.run.smithi144.stdout:generic/257 1s 2023-12-19T14:22:34.986 INFO:teuthology.orchestra.run.smithi144.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-19T14:22:35.892 INFO:teuthology.orchestra.run.smithi144.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:22:36.562 INFO:teuthology.orchestra.run.smithi144.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.Ca1ESYblXHscratch 2023-12-19T14:22:37.353 INFO:teuthology.orchestra.run.smithi144.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:22:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:36.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:36.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:36.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:36.467 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-19T14:23:36.466+0000 7f8efc5ae640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97096) UID: 0 2023-12-19T14:23:36.468 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-19T14:23:36.466+0000 7effdbaee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97096) UID: 0 2023-12-19T14:23:36.468 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-19T14:23:36.466+0000 7fb96e43e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97096) UID: 0 2023-12-19T14:23:36.468 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-19T14:23:36.466+0000 7f95e3e8a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97096) UID: 0 2023-12-19T14:23:38.641 INFO:teuthology.orchestra.run.smithi144.stdout:generic/263 60s 2023-12-19T14:23:39.445 INFO:teuthology.orchestra.run.smithi144.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:40.307 INFO:teuthology.orchestra.run.smithi144.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:41.146 INFO:teuthology.orchestra.run.smithi144.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:41.964 INFO:teuthology.orchestra.run.smithi144.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:42.807 INFO:teuthology.orchestra.run.smithi144.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:43.601 INFO:teuthology.orchestra.run.smithi144.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:44.420 INFO:teuthology.orchestra.run.smithi144.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:45.281 INFO:teuthology.orchestra.run.smithi144.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:45.743 INFO:teuthology.orchestra.run.smithi144.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-19T14:23:46.582 INFO:teuthology.orchestra.run.smithi144.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:47.414 INFO:teuthology.orchestra.run.smithi144.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:48.268 INFO:teuthology.orchestra.run.smithi144.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:49.107 INFO:teuthology.orchestra.run.smithi144.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:49.967 INFO:teuthology.orchestra.run.smithi144.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:50.758 INFO:teuthology.orchestra.run.smithi144.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:51.247 INFO:teuthology.orchestra.run.smithi144.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:23:52.026 INFO:teuthology.orchestra.run.smithi144.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:52.683 INFO:teuthology.orchestra.run.smithi144.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.Ca1ESYblXHscratch 2023-12-19T14:23:53.456 INFO:teuthology.orchestra.run.smithi144.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:54.248 INFO:teuthology.orchestra.run.smithi144.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:55.037 INFO:teuthology.orchestra.run.smithi144.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:55.826 INFO:teuthology.orchestra.run.smithi144.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:56.605 INFO:teuthology.orchestra.run.smithi144.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:57.717 INFO:teuthology.orchestra.run.smithi144.stdout:generic/294 1s 2023-12-19T14:23:58.588 INFO:teuthology.orchestra.run.smithi144.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:23:59.372 INFO:teuthology.orchestra.run.smithi144.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:00.156 INFO:teuthology.orchestra.run.smithi144.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:00.968 INFO:teuthology.orchestra.run.smithi144.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:01.522 INFO:teuthology.orchestra.run.smithi144.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:24:02.052 INFO:teuthology.orchestra.run.smithi144.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T14:24:02.865 INFO:teuthology.orchestra.run.smithi144.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:03.849 INFO:teuthology.orchestra.run.smithi144.stdout:generic/306 1s 2023-12-19T14:24:06.306 INFO:teuthology.orchestra.run.smithi144.stdout:generic/307 3s 2023-12-19T14:24:06.874 INFO:teuthology.orchestra.run.smithi144.stdout:generic/308 0s 2023-12-19T14:24:08.435 INFO:teuthology.orchestra.run.smithi144.stdout:generic/309 2s 2023-12-19T14:24:08.879 INFO:teuthology.orchestra.run.smithi144.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:24:13.442 INFO:teuthology.orchestra.run.smithi144.stdout:generic/313 5s 2023-12-19T14:24:14.395 INFO:teuthology.orchestra.run.smithi144.stdout:generic/314 1s 2023-12-19T14:24:14.786 INFO:teuthology.orchestra.run.smithi144.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T14:24:24.562 INFO:teuthology.orchestra.run.smithi144.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:24:25.892 INFO:teuthology.orchestra.run.smithi144.stdout:generic/317 - output mismatch (see /tmp/tmp.nnuPRzScSZxfstests-dev/results//generic/317.out.bad) 2023-12-19T14:24:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: --- tests/generic/317.out 2023-12-19 13:33:55.861764667 +0000 2023-12-19T14:24:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: +++ /tmp/tmp.nnuPRzScSZxfstests-dev/results//generic/317.out.bad 2023-12-19 14:24:25.886437893 +0000 2023-12-19T14:24:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: @@ -4,9 +4,7 @@ 2023-12-19T14:24:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 0 Filetype: Regular File 2023-12-19T14:24:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-19T14:24:25.898 INFO:teuthology.orchestra.run.smithi144.stdout: From user_ns 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: - Size: 0 Filetype: Regular File 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: +execvp: Permission denied 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: *** Remounting *** 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: @@ -15,6 +13,4 @@ 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 0 Filetype: Regular File 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: From user_ns 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: - Size: 0 Filetype: Regular File 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-19T14:24:25.899 INFO:teuthology.orchestra.run.smithi144.stdout: +execvp: Permission denied 2023-12-19T14:24:26.918 INFO:teuthology.orchestra.run.smithi144.stdout:generic/318 1s 2023-12-19T14:24:27.762 INFO:teuthology.orchestra.run.smithi144.stdout:generic/319 1s 2023-12-19T14:24:28.311 INFO:teuthology.orchestra.run.smithi144.stdout:generic/321 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:28.805 INFO:teuthology.orchestra.run.smithi144.stdout:generic/322 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:29.261 INFO:teuthology.orchestra.run.smithi144.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-19T14:24:29.741 INFO:teuthology.orchestra.run.smithi144.stdout:generic/325 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:30.581 INFO:teuthology.orchestra.run.smithi144.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:31.390 INFO:teuthology.orchestra.run.smithi144.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:32.208 INFO:teuthology.orchestra.run.smithi144.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:33.029 INFO:teuthology.orchestra.run.smithi144.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:33.825 INFO:teuthology.orchestra.run.smithi144.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:34.667 INFO:teuthology.orchestra.run.smithi144.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:35.445 INFO:teuthology.orchestra.run.smithi144.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:24:35.912 INFO:teuthology.orchestra.run.smithi144.stdout:generic/335 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:36.403 INFO:teuthology.orchestra.run.smithi144.stdout:generic/336 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:37.551 INFO:teuthology.orchestra.run.smithi144.stdout:generic/337 1s 2023-12-19T14:24:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:generic/338 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:38.459 INFO:teuthology.orchestra.run.smithi144.stdout:generic/341 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:38.889 INFO:teuthology.orchestra.run.smithi144.stdout:generic/342 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:24:39.425 INFO:teuthology.orchestra.run.smithi144.stdout:generic/343 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:26:30.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:30.534 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:30.537 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:30.585 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T14:26:30.584+0000 7fdb555bd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102288) UID: 0 2023-12-19T14:26:30.586 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T14:26:30.584+0000 7f97252d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102288) UID: 0 2023-12-19T14:26:30.586 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T14:26:30.584+0000 7f27baa19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102288) UID: 0 2023-12-19T14:26:30.587 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T14:26:30.585+0000 7f563af75640 -1 Fail to open '/proc/102288/cmdline' error = (2) No such file or directory 2023-12-19T14:26:30.587 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T14:26:30.585+0000 7f563af75640 -1 received signal: Hangup from (PID: 102288) UID: 0 2023-12-19T14:28:25.406 INFO:teuthology.orchestra.run.smithi144.stdout:generic/346 226s 2023-12-19T14:28:26.012 INFO:teuthology.orchestra.run.smithi144.stdout:generic/347 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:28:26.535 INFO:teuthology.orchestra.run.smithi144.stdout:generic/348 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:28:27.338 INFO:teuthology.orchestra.run.smithi144.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:28:28.624 INFO:teuthology.orchestra.run.smithi144.stdout:generic/355 1s 2023-12-19T14:28:29.375 INFO:teuthology.orchestra.run.smithi144.stdout:generic/356 [not run] swapfiles are not supported 2023-12-19T14:28:30.127 INFO:teuthology.orchestra.run.smithi144.stdout:generic/357 [not run] swapfiles are not supported 2023-12-19T14:28:30.936 INFO:teuthology.orchestra.run.smithi144.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:28:31.760 INFO:teuthology.orchestra.run.smithi144.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:28:32.299 INFO:teuthology.orchestra.run.smithi144.stdout:generic/360 1s 2023-12-19T14:28:32.728 INFO:teuthology.orchestra.run.smithi144.stdout:generic/361 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:28:33.162 INFO:teuthology.orchestra.run.smithi144.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:33.611 INFO:teuthology.orchestra.run.smithi144.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:34.040 INFO:teuthology.orchestra.run.smithi144.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:34.497 INFO:teuthology.orchestra.run.smithi144.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:34.949 INFO:teuthology.orchestra.run.smithi144.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:35.870 INFO:teuthology.orchestra.run.smithi144.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:36.334 INFO:teuthology.orchestra.run.smithi144.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:36.790 INFO:teuthology.orchestra.run.smithi144.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T14:28:37.263 INFO:teuthology.orchestra.run.smithi144.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:28:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:28:38.846 INFO:teuthology.orchestra.run.smithi144.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:28:39.563 INFO:teuthology.orchestra.run.smithi144.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T14:28:40.349 INFO:teuthology.orchestra.run.smithi144.stdout:generic/375 1s 2023-12-19T14:28:40.828 INFO:teuthology.orchestra.run.smithi144.stdout:generic/376 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:28:42.019 INFO:teuthology.orchestra.run.smithi144.stdout:generic/377 2s 2023-12-19T14:28:43.058 INFO:teuthology.orchestra.run.smithi144.stdout:generic/378 1s 2023-12-19T14:28:43.522 INFO:teuthology.orchestra.run.smithi144.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:43.977 INFO:teuthology.orchestra.run.smithi144.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:44.440 INFO:teuthology.orchestra.run.smithi144.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:44.897 INFO:teuthology.orchestra.run.smithi144.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:45.332 INFO:teuthology.orchestra.run.smithi144.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:45.794 INFO:teuthology.orchestra.run.smithi144.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:46.250 INFO:teuthology.orchestra.run.smithi144.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:46.686 INFO:teuthology.orchestra.run.smithi144.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:47.149 INFO:teuthology.orchestra.run.smithi144.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-19T14:28:47.635 INFO:teuthology.orchestra.run.smithi144.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:28:48.272 INFO:teuthology.orchestra.run.smithi144.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-19T14:28:50.023 INFO:teuthology.orchestra.run.smithi144.stdout:generic/393 2s 2023-12-19T14:28:50.615 INFO:teuthology.orchestra.run.smithi144.stdout:generic/394 0s 2023-12-19T14:28:51.219 INFO:teuthology.orchestra.run.smithi144.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:28:51.848 INFO:teuthology.orchestra.run.smithi144.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:28:52.498 INFO:teuthology.orchestra.run.smithi144.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:28:53.091 INFO:teuthology.orchestra.run.smithi144.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:28:53.525 INFO:teuthology.orchestra.run.smithi144.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:28:54.738 INFO:teuthology.orchestra.run.smithi144.stdout:generic/401 1s 2023-12-19T14:28:55.498 INFO:teuthology.orchestra.run.smithi144.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-19T14:28:57.146 INFO:teuthology.orchestra.run.smithi144.stdout:generic/403 2s 2023-12-19T14:28:57.707 INFO:teuthology.orchestra.run.smithi144.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:29:01.814 INFO:teuthology.orchestra.run.smithi144.stdout:generic/406 4s 2023-12-19T14:29:02.417 INFO:teuthology.orchestra.run.smithi144.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:29:02.964 INFO:teuthology.orchestra.run.smithi144.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T14:29:03.444 INFO:teuthology.orchestra.run.smithi144.stdout:generic/409 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-12-19T14:29:03.941 INFO:teuthology.orchestra.run.smithi144.stdout:generic/410 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-12-19T14:29:04.410 INFO:teuthology.orchestra.run.smithi144.stdout:generic/411 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-12-19T14:29:05.841 INFO:teuthology.orchestra.run.smithi144.stdout:generic/412 1s 2023-12-19T14:29:06.530 INFO:teuthology.orchestra.run.smithi144.stdout:generic/413 [not run] mount 172.21.15.6:6789:/scratch with dax failed 2023-12-19T14:29:07.321 INFO:teuthology.orchestra.run.smithi144.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:29:07.958 INFO:teuthology.orchestra.run.smithi144.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-19T14:29:08.556 INFO:teuthology.orchestra.run.smithi144.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:29:19.232 INFO:teuthology.orchestra.run.smithi144.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:29:19.844 INFO:teuthology.orchestra.run.smithi144.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:29:20.349 INFO:teuthology.orchestra.run.smithi144.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T14:29:20.982 INFO:teuthology.orchestra.run.smithi144.stdout:generic/423 0s 2023-12-19T14:29:21.463 INFO:teuthology.orchestra.run.smithi144.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-19T14:29:21.994 INFO:teuthology.orchestra.run.smithi144.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-19T14:29:32.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:32.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:32.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:44.166 INFO:teuthology.orchestra.run.smithi144.stdout:generic/426 22s 2023-12-19T14:29:44.991 INFO:teuthology.orchestra.run.smithi144.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T14:29:45.518 INFO:teuthology.orchestra.run.smithi144.stdout:generic/428 0s 2023-12-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi144.stdout:generic/430 1s 2023-12-19T14:29:46.875 INFO:teuthology.orchestra.run.smithi144.stdout:generic/431 0s 2023-12-19T14:29:47.601 INFO:teuthology.orchestra.run.smithi144.stdout:generic/432 1s 2023-12-19T14:29:48.246 INFO:teuthology.orchestra.run.smithi144.stdout:generic/433 1s 2023-12-19T14:29:48.903 INFO:teuthology.orchestra.run.smithi144.stdout:generic/434 0s 2023-12-19T14:29:49.643 INFO:teuthology.orchestra.run.smithi144.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:29:50.989 INFO:teuthology.orchestra.run.smithi144.stdout:generic/437 1s 2023-12-19T14:29:59.868 INFO:teuthology.orchestra.run.smithi144.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:30:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:30:01.004 INFO:teuthology.orchestra.run.smithi144.stdout:generic/441 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:30:01.514 INFO:teuthology.orchestra.run.smithi144.stdout:generic/443 0s 2023-12-19T14:30:02.135 INFO:teuthology.orchestra.run.smithi144.stdout:generic/444 1s 2023-12-19T14:30:02.853 INFO:teuthology.orchestra.run.smithi144.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:30:03.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:03.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:03.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:11.810 INFO:teuthology.orchestra.run.smithi144.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:30:12.726 INFO:teuthology.orchestra.run.smithi144.stdout:generic/448 1s 2023-12-19T14:30:13.246 INFO:teuthology.orchestra.run.smithi144.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T14:30:19.219 INFO:teuthology.orchestra.run.smithi144.stdout:generic/450 6s 2023-12-19T14:30:34.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:34.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:34.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:49.839 INFO:teuthology.orchestra.run.smithi144.stdout:generic/451 30s 2023-12-19T14:30:51.534 INFO:teuthology.orchestra.run.smithi144.stdout:generic/452 2s 2023-12-19T14:30:52.045 INFO:teuthology.orchestra.run.smithi144.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-19T14:30:52.514 INFO:teuthology.orchestra.run.smithi144.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-19T14:30:53.033 INFO:teuthology.orchestra.run.smithi144.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:30:53.847 INFO:teuthology.orchestra.run.smithi144.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:31:04.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:04.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:04.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:34.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:34.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:34.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:05.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:05.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:05.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:05.209 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-12-19T14:32:05.207+0000 7f97252d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102409) UID: 0 2023-12-19T14:32:05.209 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T14:32:05.208+0000 7fdb555bd640 -1 Fail to open '/proc/102409/cmdline' error = (2) No such file or directory 2023-12-19T14:32:05.209 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-12-19T14:32:05.208+0000 7fdb555bd640 -1 received signal: Hangup from (PID: 102409) UID: 0 2023-12-19T14:32:05.211 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T14:32:05.210+0000 7f563af75640 -1 Fail to open '/proc/102409/cmdline' error = (2) No such file or directory 2023-12-19T14:32:05.211 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-12-19T14:32:05.210+0000 7f563af75640 -1 received signal: Hangup from (PID: 102409) UID: 0 2023-12-19T14:32:05.212 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T14:32:05.211+0000 7f27baa19640 -1 Fail to open '/proc/102409/cmdline' error = (2) No such file or directory 2023-12-19T14:32:05.212 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-12-19T14:32:05.211+0000 7f27baa19640 -1 received signal: Hangup from (PID: 102409) UID: 0 2023-12-19T14:35:19.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:19.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:19.685 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:49.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:49.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:49.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:00.849 INFO:teuthology.orchestra.run.smithi144.stdout:generic/460 307s 2023-12-19T14:36:01.537 INFO:teuthology.orchestra.run.smithi144.stdout:generic/462 [not run] mount 172.21.15.6:6789:/scratch with dax failed 2023-12-19T14:36:02.091 INFO:teuthology.orchestra.run.smithi144.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:36:09.241 INFO:teuthology.orchestra.run.smithi144.stdout:generic/465 7s 2023-12-19T14:36:09.748 INFO:teuthology.orchestra.run.smithi144.stdout:generic/466 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:36:12.372 INFO:teuthology.orchestra.run.smithi144.stdout:generic/467 3s 2023-12-19T14:36:14.021 INFO:teuthology.orchestra.run.smithi144.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-19T14:36:14.535 INFO:teuthology.orchestra.run.smithi144.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T14:36:15.088 INFO:teuthology.orchestra.run.smithi144.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-19T14:36:20.209 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:20.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:20.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:50.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:50.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:50.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:52.794 INFO:teuthology.orchestra.run.smithi144.stdout:generic/471 37s 2023-12-19T14:36:53.736 INFO:teuthology.orchestra.run.smithi144.stdout:generic/472 [not run] swapfiles are not supported 2023-12-19T14:36:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-19T14:37:00.021 INFO:teuthology.orchestra.run.smithi144.stdout:generic/477 5s 2023-12-19T14:37:12.270 INFO:teuthology.orchestra.run.smithi144.stdout:generic/478 12s 2023-12-19T14:37:12.829 INFO:teuthology.orchestra.run.smithi144.stdout:generic/479 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:13.366 INFO:teuthology.orchestra.run.smithi144.stdout:generic/480 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:13.869 INFO:teuthology.orchestra.run.smithi144.stdout:generic/481 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:14.357 INFO:teuthology.orchestra.run.smithi144.stdout:generic/483 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:14.819 INFO:teuthology.orchestra.run.smithi144.stdout:generic/484 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:15.312 INFO:teuthology.orchestra.run.smithi144.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T14:37:16.940 INFO:teuthology.orchestra.run.smithi144.stdout:generic/486 1s 2023-12-19T14:37:17.517 INFO:teuthology.orchestra.run.smithi144.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-19T14:37:17.997 INFO:teuthology.orchestra.run.smithi144.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T14:37:18.500 INFO:teuthology.orchestra.run.smithi144.stdout:generic/489 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:19.317 INFO:teuthology.orchestra.run.smithi144.stdout:generic/490 1s 2023-12-19T14:37:19.814 INFO:teuthology.orchestra.run.smithi144.stdout:generic/491 [not run] ceph does not support freezing 2023-12-19T14:37:20.285 INFO:teuthology.orchestra.run.smithi144.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-19T14:37:21.097 INFO:teuthology.orchestra.run.smithi144.stdout:generic/493 [not run] swapfiles are not supported 2023-12-19T14:37:21.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:21.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:21.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:generic/494 [not run] swapfiles are not supported 2023-12-19T14:37:22.578 INFO:teuthology.orchestra.run.smithi144.stdout:generic/495 [not run] swapfiles are not supported 2023-12-19T14:37:23.324 INFO:teuthology.orchestra.run.smithi144.stdout:generic/496 [not run] swapfiles are not supported 2023-12-19T14:37:24.089 INFO:teuthology.orchestra.run.smithi144.stdout:generic/497 [not run] swapfiles are not supported 2023-12-19T14:37:24.602 INFO:teuthology.orchestra.run.smithi144.stdout:generic/498 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:25.077 INFO:teuthology.orchestra.run.smithi144.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T14:37:25.922 INFO:teuthology.orchestra.run.smithi144.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:37:26.449 INFO:teuthology.orchestra.run.smithi144.stdout:generic/502 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:26.958 INFO:teuthology.orchestra.run.smithi144.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:37:27.539 INFO:teuthology.orchestra.run.smithi144.stdout:generic/504 1s 2023-12-19T14:37:28.187 INFO:teuthology.orchestra.run.smithi144.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-19T14:37:28.667 INFO:teuthology.orchestra.run.smithi144.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:37:29.122 INFO:teuthology.orchestra.run.smithi144.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-19T14:37:29.561 INFO:teuthology.orchestra.run.smithi144.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-19T14:37:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-19T14:37:30.532 INFO:teuthology.orchestra.run.smithi144.stdout:generic/510 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:31.007 INFO:teuthology.orchestra.run.smithi144.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T14:37:31.520 INFO:teuthology.orchestra.run.smithi144.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:37:32.337 INFO:teuthology.orchestra.run.smithi144.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:37:33.133 INFO:teuthology.orchestra.run.smithi144.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:37:33.974 INFO:teuthology.orchestra.run.smithi144.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:37:34.490 INFO:teuthology.orchestra.run.smithi144.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T14:37:35.229 INFO:teuthology.orchestra.run.smithi144.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T14:37:36.201 INFO:teuthology.orchestra.run.smithi144.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:37:36.694 INFO:teuthology.orchestra.run.smithi144.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-19T14:37:37.176 INFO:teuthology.orchestra.run.smithi144.stdout:generic/520 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:37:38.254 INFO:teuthology.orchestra.run.smithi144.stdout:generic/523 1s 2023-12-19T14:37:51.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:51.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:51.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:21.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:21.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:21.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:51.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:51.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:51.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:22.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:22.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:22.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:52.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:52.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:52.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:22.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:22.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:22.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:50.509 INFO:teuthology.orchestra.run.smithi144.stdout:generic/524 192s 2023-12-19T14:40:51.282 INFO:teuthology.orchestra.run.smithi144.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-19T14:40:51.797 INFO:teuthology.orchestra.run.smithi144.stdout:generic/526 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:40:52.314 INFO:teuthology.orchestra.run.smithi144.stdout:generic/527 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:40:52.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:52.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:52.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:52.949 INFO:teuthology.orchestra.run.smithi144.stdout:generic/528 0s 2023-12-19T14:40:53.945 INFO:teuthology.orchestra.run.smithi144.stdout:generic/529 1s 2023-12-19T14:40:54.628 INFO:teuthology.orchestra.run.smithi144.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-19T14:40:55.116 INFO:teuthology.orchestra.run.smithi144.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-19T14:40:55.644 INFO:teuthology.orchestra.run.smithi144.stdout:generic/532 0s 2023-12-19T14:40:56.689 INFO:teuthology.orchestra.run.smithi144.stdout:generic/533 1s 2023-12-19T14:40:57.153 INFO:teuthology.orchestra.run.smithi144.stdout:generic/534 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:40:57.653 INFO:teuthology.orchestra.run.smithi144.stdout:generic/535 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:40:58.272 INFO:teuthology.orchestra.run.smithi144.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-19T14:40:58.926 INFO:teuthology.orchestra.run.smithi144.stdout:generic/537 [not run] FSTRIM not supported 2023-12-19T14:41:22.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:22.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:22.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:53.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:53.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:53.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:23.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:23.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:23.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:53.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:53.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:53.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:23.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:23.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:23.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:53.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:53.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:53.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:24.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:24.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:24.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:54.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:54.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:54.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:24.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:24.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:24.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:54.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:54.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:54.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:24.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:24.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:24.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:55.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:55.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:55.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:25.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:25.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:25.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:55.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:55.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:55.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:25.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:25.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:25.855 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:56.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:56.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:56.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:26.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:26.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:26.301 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:56.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:56.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:56.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:26.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:26.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:26.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:57.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:57.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:57.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:27.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:27.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:27.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:57.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:57.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:57.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:27.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:27.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:27.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:57.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:57.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:57.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:28.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:28.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:28.065 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:58.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:58.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:58.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:28.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:28.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:28.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:58.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:58.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:58.709 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:28.908 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:28.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:28.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:34.404 INFO:teuthology.orchestra.run.smithi144.stdout:generic/538 876s 2023-12-19T14:55:44.985 INFO:teuthology.orchestra.run.smithi144.stdout:generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:55:45.785 INFO:teuthology.orchestra.run.smithi144.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:55:46.564 INFO:teuthology.orchestra.run.smithi144.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:55:47.324 INFO:teuthology.orchestra.run.smithi144.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:55:48.143 INFO:teuthology.orchestra.run.smithi144.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:55:48.956 INFO:teuthology.orchestra.run.smithi144.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:55:49.446 INFO:teuthology.orchestra.run.smithi144.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-19T14:55:49.954 INFO:teuthology.orchestra.run.smithi144.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:55:50.485 INFO:teuthology.orchestra.run.smithi144.stdout:generic/547 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:55:51.108 INFO:teuthology.orchestra.run.smithi144.stdout:generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:55:51.711 INFO:teuthology.orchestra.run.smithi144.stdout:generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:55:52.331 INFO:teuthology.orchestra.run.smithi144.stdout:generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:55:52.871 INFO:teuthology.orchestra.run.smithi144.stdout:generic/552 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:55:53.441 INFO:teuthology.orchestra.run.smithi144.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-12-19T14:55:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:generic/554 [not run] swapfiles are not supported 2023-12-19T14:55:54.777 INFO:teuthology.orchestra.run.smithi144.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-12-19T14:55:55.256 INFO:teuthology.orchestra.run.smithi144.stdout:generic/556 [not run] ceph does not support casefold feature 2023-12-19T14:55:55.720 INFO:teuthology.orchestra.run.smithi144.stdout:generic/557 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:55:56.258 INFO:teuthology.orchestra.run.smithi144.stdout:generic/563 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:55:57.134 INFO:teuthology.orchestra.run.smithi144.stdout:generic/564 1s 2023-12-19T14:55:58.092 INFO:teuthology.orchestra.run.smithi144.stdout:generic/565 1s 2023-12-19T14:55:58.544 INFO:teuthology.orchestra.run.smithi144.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:55:59.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:59.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:59.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:08.471 INFO:teuthology.orchestra.run.smithi144.stdout:generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T14:56:08.940 INFO:teuthology.orchestra.run.smithi144.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:56:09.425 INFO:teuthology.orchestra.run.smithi144.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:56:09.903 INFO:teuthology.orchestra.run.smithi144.stdout:generic/570 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:56:10.399 INFO:teuthology.orchestra.run.smithi144.stdout:generic/571 [not run] Require fcntl setlease support 2023-12-19T14:56:10.859 INFO:teuthology.orchestra.run.smithi144.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:11.310 INFO:teuthology.orchestra.run.smithi144.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:11.758 INFO:teuthology.orchestra.run.smithi144.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:12.192 INFO:teuthology.orchestra.run.smithi144.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:12.769 INFO:teuthology.orchestra.run.smithi144.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:13.258 INFO:teuthology.orchestra.run.smithi144.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:13.774 INFO:teuthology.orchestra.run.smithi144.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T14:56:14.432 INFO:teuthology.orchestra.run.smithi144.stdout:generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:15.779 INFO:teuthology.orchestra.run.smithi144.stdout:generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:16.331 INFO:teuthology.orchestra.run.smithi144.stdout:generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:16.856 INFO:teuthology.orchestra.run.smithi144.stdout:generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:17.391 INFO:teuthology.orchestra.run.smithi144.stdout:generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:17.923 INFO:teuthology.orchestra.run.smithi144.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T14:56:18.435 INFO:teuthology.orchestra.run.smithi144.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:56:19.270 INFO:teuthology.orchestra.run.smithi144.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:56:19.930 INFO:teuthology.orchestra.run.smithi144.stdout:generic/591 0s 2023-12-19T14:56:20.530 INFO:teuthology.orchestra.run.smithi144.stdout:generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:21.091 INFO:teuthology.orchestra.run.smithi144.stdout:generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:21.604 INFO:teuthology.orchestra.run.smithi144.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:56:22.218 INFO:teuthology.orchestra.run.smithi144.stdout:generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:22.758 INFO:teuthology.orchestra.run.smithi144.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-12-19T14:56:24.128 INFO:teuthology.orchestra.run.smithi144.stdout:generic/597 2s 2023-12-19T14:56:25.509 INFO:teuthology.orchestra.run.smithi144.stdout:generic/598 1s 2023-12-19T14:56:26.148 INFO:teuthology.orchestra.run.smithi144.stdout:generic/599 [not run] ceph does not support shutdown 2023-12-19T14:56:26.624 INFO:teuthology.orchestra.run.smithi144.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:56:27.054 INFO:teuthology.orchestra.run.smithi144.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:56:27.651 INFO:teuthology.orchestra.run.smithi144.stdout:generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:28.119 INFO:teuthology.orchestra.run.smithi144.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T14:56:29.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:29.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:29.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:33.123 INFO:teuthology.orchestra.run.smithi144.stdout:generic/604 5s 2023-12-19T14:56:35.084 INFO:teuthology.orchestra.run.smithi144.stdout:generic/605 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed 2023-12-19T14:56:35.845 INFO:teuthology.orchestra.run.smithi144.stdout:generic/606 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed 2023-12-19T14:56:36.336 INFO:teuthology.orchestra.run.smithi144.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-12-19T14:56:36.950 INFO:teuthology.orchestra.run.smithi144.stdout:generic/608 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed 2023-12-19T14:56:37.673 INFO:teuthology.orchestra.run.smithi144.stdout:generic/609 1s 2023-12-19T14:56:47.206 INFO:teuthology.orchestra.run.smithi144.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T14:56:48.252 INFO:teuthology.orchestra.run.smithi144.stdout:generic/611 1s 2023-12-19T14:56:48.887 INFO:teuthology.orchestra.run.smithi144.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T14:56:49.486 INFO:teuthology.orchestra.run.smithi144.stdout:generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:50.157 INFO:teuthology.orchestra.run.smithi144.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-12-19T14:56:51.194 INFO:teuthology.orchestra.run.smithi144.stdout:generic/618 1s 2023-12-19T14:56:51.762 INFO:teuthology.orchestra.run.smithi144.stdout:generic/620 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:56:52.378 INFO:teuthology.orchestra.run.smithi144.stdout:generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T14:56:53.045 INFO:teuthology.orchestra.run.smithi144.stdout:generic/623 [not run] ceph does not support shutdown 2023-12-19T14:56:53.529 INFO:teuthology.orchestra.run.smithi144.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:53.990 INFO:teuthology.orchestra.run.smithi144.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-12-19T14:56:54.519 INFO:teuthology.orchestra.run.smithi144.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-12-19T14:56:55.373 INFO:teuthology.orchestra.run.smithi144.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:56:55.875 INFO:teuthology.orchestra.run.smithi144.stdout:generic/629 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:56:56.622 INFO:teuthology.orchestra.run.smithi144.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T14:56:58.769 INFO:teuthology.orchestra.run.smithi144.stdout:generic/632 2s 2023-12-19T14:56:59.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:59.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:59.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:generic/633 2s 2023-12-19T14:57:02.294 INFO:teuthology.orchestra.run.smithi144.stdout:generic/634 2s 2023-12-19T14:57:03.011 INFO:teuthology.orchestra.run.smithi144.stdout:generic/635 [not run] ceph does not support shutdown 2023-12-19T14:57:03.763 INFO:teuthology.orchestra.run.smithi144.stdout:generic/636 [not run] swapfiles are not supported 2023-12-19T14:57:04.760 INFO:teuthology.orchestra.run.smithi144.stdout:generic/637 1s 2023-12-19T14:57:05.301 INFO:teuthology.orchestra.run.smithi144.stdout:generic/638 1s 2023-12-19T14:57:06.249 INFO:teuthology.orchestra.run.smithi144.stdout:generic/639 1s 2023-12-19T14:57:06.739 INFO:teuthology.orchestra.run.smithi144.stdout:generic/640 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T14:57:07.501 INFO:teuthology.orchestra.run.smithi144.stdout:generic/641 [not run] swapfiles are not supported 2023-12-19T14:57:08.072 INFO:teuthology.orchestra.run.smithi144.stdout:generic/644 1s 2023-12-19T14:57:29.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:29.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:29.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:59.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:59.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:59.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:59.869 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T14:57:59.869+0000 7f3e2e3ec640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103273) UID: 0 2023-12-19T14:57:59.869 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-12-19T14:57:59.869+0000 7ff1fa279640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103273) UID: 0 2023-12-19T14:59:07.641 INFO:teuthology.orchestra.run.smithi144.stdout:generic/645 119s 2023-12-19T14:59:08.361 INFO:teuthology.orchestra.run.smithi144.stdout:generic/646 [not run] ceph does not support shutdown 2023-12-19T14:59:09.100 INFO:teuthology.orchestra.run.smithi144.stdout:generic/647 1s 2023-12-19T14:59:09.884 INFO:teuthology.orchestra.run.smithi144.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:10.682 INFO:teuthology.orchestra.run.smithi144.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:11.475 INFO:teuthology.orchestra.run.smithi144.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:12.224 INFO:teuthology.orchestra.run.smithi144.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:13.028 INFO:teuthology.orchestra.run.smithi144.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:13.813 INFO:teuthology.orchestra.run.smithi144.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:14.606 INFO:teuthology.orchestra.run.smithi144.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:15.419 INFO:teuthology.orchestra.run.smithi144.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:16.224 INFO:teuthology.orchestra.run.smithi144.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:17.006 INFO:teuthology.orchestra.run.smithi144.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:17.788 INFO:teuthology.orchestra.run.smithi144.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:18.578 INFO:teuthology.orchestra.run.smithi144.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:19.363 INFO:teuthology.orchestra.run.smithi144.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:20.141 INFO:teuthology.orchestra.run.smithi144.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:20.970 INFO:teuthology.orchestra.run.smithi144.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:22.553 INFO:teuthology.orchestra.run.smithi144.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:23.344 INFO:teuthology.orchestra.run.smithi144.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:24.505 INFO:teuthology.orchestra.run.smithi144.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T14:59:25.285 INFO:teuthology.orchestra.run.smithi144.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T14:59:26.298 INFO:teuthology.orchestra.run.smithi144.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T15:01:30.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:30.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:30.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:00.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:00.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:00.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:00.356 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T15:02:00.356+0000 7f3e2e3ec640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103326) UID: 0 2023-12-19T15:02:00.357 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-12-19T15:02:00.356+0000 7ff1fa279640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103326) UID: 0 2023-12-19T15:04:37.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:37.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:37.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:08.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:08.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:08.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:38.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:38.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:38.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:38.464 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T15:05:38.463+0000 7f3e2e3ec640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103386) UID: 0 2023-12-19T15:05:38.464 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-12-19T15:05:38.463+0000 7ff1fa279640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103386) UID: 0 2023-12-19T15:08:05.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:05.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:05.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:35.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:35.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:35.929 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:06.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:06.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:06.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:06.302 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T15:09:06.302+0000 7f3e2e3ec640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103444) UID: 0 2023-12-19T15:09:06.302 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-12-19T15:09:06.302+0000 7ff1fa279640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103444) UID: 0 2023-12-19T15:11:36.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:36.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:36.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:06.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:06.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:07.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:37.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:37.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:37.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:37.255 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-12-19T15:12:37.255+0000 7f3e2e3ec640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103507) UID: 0 2023-12-19T15:12:37.256 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-12-19T15:12:37.255+0000 7ff1fa279640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103507) UID: 0 2023-12-19T15:12:46.523 INFO:teuthology.orchestra.run.smithi144.stdout:generic/676 800s 2023-12-19T15:12:47.049 INFO:teuthology.orchestra.run.smithi144.stdout:generic/677 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T15:12:47.696 INFO:teuthology.orchestra.run.smithi144.stdout:generic/678 [not run] kernel does not support IO_URING 2023-12-19T15:12:48.188 INFO:teuthology.orchestra.run.smithi144.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T15:12:49.175 INFO:teuthology.orchestra.run.smithi144.stdout:generic/680 1s 2023-12-19T15:12:49.595 INFO:teuthology.orchestra.run.smithi144.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T15:12:50.047 INFO:teuthology.orchestra.run.smithi144.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T15:12:50.603 INFO:teuthology.orchestra.run.smithi144.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T15:13:01.546 INFO:teuthology.orchestra.run.smithi144.stdout:generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T15:13:11.689 INFO:teuthology.orchestra.run.smithi144.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T15:13:20.999 INFO:teuthology.orchestra.run.smithi144.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-19T15:13:29.912 INFO:teuthology.orchestra.run.smithi144.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-19T15:13:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T15:13:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:generic/689 1s 2023-12-19T15:13:31.532 INFO:teuthology.orchestra.run.smithi144.stdout:generic/690 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T15:13:32.009 INFO:teuthology.orchestra.run.smithi144.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-12-19T15:13:32.618 INFO:teuthology.orchestra.run.smithi144.stdout:generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T15:13:33.125 INFO:teuthology.orchestra.run.smithi144.stdout:generic/695 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-12-19T15:13:33.880 INFO:teuthology.orchestra.run.smithi144.stdout:generic/696 0s 2023-12-19T15:13:34.444 INFO:teuthology.orchestra.run.smithi144.stdout:generic/697 1s 2023-12-19T15:13:36.237 INFO:teuthology.orchestra.run.smithi144.stdout:generic/698 2s 2023-12-19T15:13:37.328 INFO:teuthology.orchestra.run.smithi144.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2023-12-19T15:13:37.851 INFO:teuthology.orchestra.run.smithi144.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-12-19T15:13:38.680 INFO:teuthology.orchestra.run.smithi144.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T15:13:39.223 INFO:teuthology.orchestra.run.smithi144.stdout:generic/703 [not run] kernel does not support IO_URING 2023-12-19T15:13:39.782 INFO:teuthology.orchestra.run.smithi144.stdout:generic/704 [not run] require 172.21.15.6:6789:/test to be valid block disk 2023-12-19T15:13:40.659 INFO:teuthology.orchestra.run.smithi144.stdout:generic/706 1s 2023-12-19T15:13:41.296 INFO:teuthology.orchestra.run.smithi144.stdout:generic/708 1s 2023-12-19T15:13:41.788 INFO:teuthology.orchestra.run.smithi144.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:42.305 INFO:teuthology.orchestra.run.smithi144.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:42.794 INFO:teuthology.orchestra.run.smithi144.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:43.285 INFO:teuthology.orchestra.run.smithi144.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:43.789 INFO:teuthology.orchestra.run.smithi144.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2023-12-19T15:13:44.277 INFO:teuthology.orchestra.run.smithi144.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:44.801 INFO:teuthology.orchestra.run.smithi144.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2023-12-19T15:13:45.315 INFO:teuthology.orchestra.run.smithi144.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:45.802 INFO:teuthology.orchestra.run.smithi144.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:46.290 INFO:teuthology.orchestra.run.smithi144.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:46.767 INFO:teuthology.orchestra.run.smithi144.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:47.222 INFO:teuthology.orchestra.run.smithi144.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:47.701 INFO:teuthology.orchestra.run.smithi144.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-12-19T15:13:48.205 INFO:teuthology.orchestra.run.smithi144.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T15:13:48.690 INFO:teuthology.orchestra.run.smithi144.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T15:13:49.175 INFO:teuthology.orchestra.run.smithi144.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T15:13:49.673 INFO:teuthology.orchestra.run.smithi144.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T15:13:50.527 INFO:teuthology.orchestra.run.smithi144.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T15:13:51.095 INFO:teuthology.orchestra.run.smithi144.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T15:13:55.662 INFO:teuthology.orchestra.run.smithi144.stdout:generic/728 4s 2023-12-19T15:13:56.324 INFO:teuthology.orchestra.run.smithi144.stdout:generic/729 1s 2023-12-19T15:13:56.806 INFO:teuthology.orchestra.run.smithi144.stdout:generic/730 [not run] require 172.21.15.6:6789:/test to be valid block disk 2023-12-19T15:13:57.294 INFO:teuthology.orchestra.run.smithi144.stdout:generic/731 [not run] require 172.21.15.6:6789:/test to be valid block disk 2023-12-19T15:13:58.344 INFO:teuthology.orchestra.run.smithi144.stdout:generic/732 1s 2023-12-19T15:13:58.858 INFO:teuthology.orchestra.run.smithi144.stdout:shared/002 [not run] not suitable for this filesystem type: ceph 2023-12-19T15:13:59.284 INFO:teuthology.orchestra.run.smithi144.stdout:shared/032 [not run] not suitable for this filesystem type: ceph 2023-12-19T15:13:59.314 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 shared/002 shared/032 2023-12-19T15:13:59.314 INFO:teuthology.orchestra.run.smithi144.stdout:Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 shared/002 shared/032 2023-12-19T15:13:59.314 INFO:teuthology.orchestra.run.smithi144.stdout:Failures: generic/317 2023-12-19T15:13:59.314 INFO:teuthology.orchestra.run.smithi144.stdout:Failed 1 of 598 tests 2023-12-19T15:13:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-12-19T15:14:00.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:14:00.078 INFO:tasks.cephfs.test_fscrypt:Command failed. 2023-12-19T15:14:00.078 INFO:tasks.cephfs.test_fscrypt:Command return value: 1 2023-12-19T15:14:00.079 INFO:tasks.cephfs.test_fscrypt:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi144 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 MKFS_OPTIONS -- 172.21.15.6:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQBZm4FlAoh0NRAAceVePsekG3Vm9nqPCFVMUg==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.Ca1ESYblXHscratch ceph/001 [expunged] ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/004 0s ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test generic/001 10s generic/002 1s generic/003 [not run] atime not maintained by ceph generic/004 [not run] O_TMPFILE is not supported generic/005 1s generic/006 23s generic/007 46s generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/011 27s generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/013 33s generic/014 141s generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/018 [not run] defragmentation not supported for fstype "ceph" generic/020 12s generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/023 2s generic/024 [not run] kernel doesn't support renameat2 syscall generic/025 [not run] kernel doesn't support renameat2 syscall generic/026 [not run] ceph does not define maximum ACL count generic/028 5s generic/029 2s generic/030 5s generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/034 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/035 1s generic/037 7s generic/039 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/040 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/041 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/042 [not run] ceph does not support shutdown generic/050 [not run] ceph does not support shutdown generic/052 [not run] ceph does not support shutdown generic/053 1s generic/056 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/057 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/059 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/062 2s generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/065 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/066 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/067 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/069 21s generic/070 18s generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/073 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/075 20s generic/076 [not run] require 172.21.15.6:6789:/scratch to be local device generic/078 [not run] kernel doesn't support renameat2 syscall generic/079 [not run] file system doesn't support chattr +ia generic/080 2s generic/081 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/082 [not run] disk quotas not supported by this filesystem type: ceph generic/084 6s generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/087 0s generic/088 1s generic/090 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/091 71s generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/097 0s generic/098 2s generic/099 1s generic/101 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/104 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/105 1s generic/106 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/107 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/108 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/110 [not run] Reflink not supported by test filesystem type: ceph generic/111 [not run] Reflink not supported by test filesystem type: ceph generic/112 27s generic/113 123s generic/114 [not run] device block size: 4096 greater than 512 generic/115 [not run] Reflink not supported by test filesystem type: ceph generic/116 [not run] Reflink not supported by test filesystem type: ceph generic/117 7s generic/118 [not run] Reflink not supported by test filesystem type: ceph generic/119 [not run] Reflink not supported by test filesystem type: ceph generic/120 [not run] atime not maintained by ceph generic/121 [not run] Dedupe not supported by test filesystem type: ceph generic/122 [not run] Dedupe not supported by test filesystem type: ceph generic/123 1s generic/124 32s generic/126 1s generic/128 11s generic/129 1318s generic/130 16s generic/131 2s generic/134 [not run] Reflink not supported by test filesystem type: ceph generic/135 1s generic/136 [not run] Dedupe not supported by test filesystem type: ceph generic/138 [not run] Reflink not supported by test filesystem type: ceph generic/139 [not run] Reflink not supported by test filesystem type: ceph generic/140 [not run] Reflink not supported by test filesystem type: ceph generic/141 1s generic/142 [not run] Reflink not supported by test filesystem type: ceph generic/143 [not run] Reflink not supported by test filesystem type: ceph generic/144 [not run] Reflink not supported by test filesystem type: ceph generic/145 [not run] Reflink not supported by test filesystem type: ceph generic/146 [not run] Reflink not supported by test filesystem type: ceph generic/147 [not run] Reflink not supported by test filesystem type: ceph generic/148 [not run] Reflink not supported by test filesystem type: ceph generic/149 [not run] Reflink not supported by test filesystem type: ceph generic/150 [not run] Reflink not supported by test filesystem type: ceph generic/151 [not run] Reflink not supported by test filesystem type: ceph generic/152 [not run] Reflink not supported by test filesystem type: ceph generic/153 [not run] Reflink not supported by test filesystem type: ceph generic/154 [not run] Reflink not supported by test filesystem type: ceph generic/155 [not run] Reflink not supported by test filesystem type: ceph generic/156 [not run] Reflink not supported by test filesystem type: ceph generic/157 [not run] Reflink not supported by test filesystem type: ceph generic/158 [not run] Dedupe not supported by test filesystem type: ceph generic/159 [not run] file system doesn't support chattr +i generic/160 [not run] file system doesn't support chattr +i generic/161 [not run] Reflink not supported by scratch filesystem type: ceph generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph generic/169 1s generic/171 [not run] Reflink not supported by scratch filesystem type: ceph generic/172 [not run] Reflink not supported by scratch filesystem type: ceph generic/173 [not run] Reflink not supported by scratch filesystem type: ceph generic/174 [not run] Reflink not supported by scratch filesystem type: ceph generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/178 [not run] Reflink not supported by test filesystem type: ceph generic/179 [not run] Reflink not supported by test filesystem type: ceph generic/180 [not run] Reflink not supported by test filesystem type: ceph generic/181 [not run] Reflink not supported by test filesystem type: ceph generic/182 [not run] Dedupe not supported by test filesystem type: ceph generic/183 [not run] Reflink not supported by scratch filesystem type: ceph generic/184 1s generic/185 [not run] Reflink not supported by scratch filesystem type: ceph generic/188 [not run] Reflink not supported by scratch filesystem type: ceph generic/189 [not run] Reflink not supported by scratch filesystem type: ceph generic/190 [not run] Reflink not supported by scratch filesystem type: ceph generic/191 [not run] Reflink not supported by scratch filesystem type: ceph generic/193 2s generic/194 [not run] Reflink not supported by scratch filesystem type: ceph generic/195 [not run] Reflink not supported by scratch filesystem type: ceph generic/196 [not run] Reflink not supported by scratch filesystem type: ceph generic/197 [not run] Reflink not supported by scratch filesystem type: ceph generic/198 36s generic/199 [not run] Reflink not supported by scratch filesystem type: ceph generic/200 [not run] Reflink not supported by scratch filesystem type: ceph generic/201 [not run] Reflink not supported by scratch filesystem type: ceph generic/202 [not run] Reflink not supported by scratch filesystem type: ceph generic/203 [not run] Reflink not supported by scratch filesystem type: ceph generic/205 [not run] Reflink not supported by scratch filesystem type: ceph generic/206 [not run] Reflink not supported by scratch filesystem type: ceph generic/207 18s generic/210 1s generic/211 1s generic/212 1s generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/215 2s generic/216 [not run] Reflink not supported by scratch filesystem type: ceph generic/217 [not run] Reflink not supported by scratch filesystem type: ceph generic/218 [not run] Reflink not supported by scratch filesystem type: ceph generic/219 [not run] disk quotas not supported by this filesystem type: ceph generic/220 [not run] Reflink not supported by scratch filesystem type: ceph generic/221 1s generic/222 [not run] Reflink not supported by scratch filesystem type: ceph generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/227 [not run] Reflink not supported by scratch filesystem type: ceph generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/229 [not run] Reflink not supported by scratch filesystem type: ceph generic/230 [not run] disk quotas not supported by this filesystem type: ceph generic/235 [not run] disk quotas not supported by this filesystem type: ceph generic/236 2s generic/237 0s generic/238 [not run] Reflink not supported by scratch filesystem type: ceph generic/240 12s generic/244 [not run] disk quotas not supported by this filesystem type: ceph generic/245 0s generic/246 0s generic/247 320s generic/248 1s generic/249 25s generic/250 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/252 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/253 [not run] Reflink not supported by scratch filesystem type: ceph generic/254 [not run] Reflink not supported by scratch filesystem type: ceph generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/257 1s generic/258 [not run] ceph does not support negative timestamps generic/259 [not run] Reflink not supported by scratch filesystem type: ceph generic/260 [not run] FITRIM not supported on /tmp/tmp.Ca1ESYblXHscratch generic/261 [not run] Reflink not supported by scratch filesystem type: ceph generic/262 [not run] Reflink not supported by scratch filesystem type: ceph generic/263 60s generic/264 [not run] Reflink not supported by scratch filesystem type: ceph generic/265 [not run] Reflink not supported by scratch filesystem type: ceph generic/266 [not run] Reflink not supported by scratch filesystem type: ceph generic/267 [not run] Reflink not supported by scratch filesystem type: ceph generic/268 [not run] Reflink not supported by scratch filesystem type: ceph generic/271 [not run] Reflink not supported by scratch filesystem type: ceph generic/272 [not run] Reflink not supported by scratch filesystem type: ceph generic/276 [not run] Reflink not supported by scratch filesystem type: ceph generic/277 [not run] file system doesn't support chattr +A generic/278 [not run] Reflink not supported by scratch filesystem type: ceph generic/279 [not run] Reflink not supported by scratch filesystem type: ceph generic/281 [not run] Reflink not supported by scratch filesystem type: ceph generic/282 [not run] Reflink not supported by scratch filesystem type: ceph generic/283 [not run] Reflink not supported by scratch filesystem type: ceph generic/284 [not run] Reflink not supported by scratch filesystem type: ceph generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/287 [not run] Reflink not supported by scratch filesystem type: ceph generic/288 [not run] FITRIM not supported on /tmp/tmp.Ca1ESYblXHscratch generic/289 [not run] Reflink not supported by scratch filesystem type: ceph generic/290 [not run] Reflink not supported by scratch filesystem type: ceph generic/291 [not run] Reflink not supported by scratch filesystem type: ceph generic/292 [not run] Reflink not supported by scratch filesystem type: ceph generic/293 [not run] Reflink not supported by scratch filesystem type: ceph generic/294 1s generic/295 [not run] Reflink not supported by scratch filesystem type: ceph generic/296 [not run] Reflink not supported by scratch filesystem type: ceph generic/301 [not run] Reflink not supported by scratch filesystem type: ceph generic/302 [not run] Reflink not supported by scratch filesystem type: ceph generic/303 [not run] Reflink not supported by test filesystem type: ceph generic/304 [not run] Dedupe not supported by test filesystem type: ceph generic/305 [not run] Reflink not supported by scratch filesystem type: ceph generic/306 1s generic/307 3s generic/308 0s generic/309 2s generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/313 5s generic/314 1s generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/317 - output mismatch (see /tmp/tmp.nnuPRzScSZxfstests-dev/results//generic/317.out.bad) --- tests/generic/317.out 2023-12-19 13:33:55.861764667 +0000 +++ /tmp/tmp.nnuPRzScSZxfstests-dev/results//generic/317.out.bad 2023-12-19 14:24:25.886437893 +0000 @@ -4,9 +4,7 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied *** Remounting *** @@ -15,6 +13,4 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied generic/318 1s generic/319 1s generic/321 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/322 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/324 [not run] defragmentation not supported for fstype "ceph" generic/325 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/326 [not run] Reflink not supported by scratch filesystem type: ceph generic/327 [not run] Reflink not supported by scratch filesystem type: ceph generic/328 [not run] Reflink not supported by scratch filesystem type: ceph generic/329 [not run] Reflink not supported by scratch filesystem type: ceph generic/330 [not run] Reflink not supported by scratch filesystem type: ceph generic/331 [not run] Reflink not supported by scratch filesystem type: ceph generic/332 [not run] Reflink not supported by scratch filesystem type: ceph generic/335 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/336 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/337 1s generic/338 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/341 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/342 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/343 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/346 226s generic/347 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/348 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/353 [not run] Reflink not supported by scratch filesystem type: ceph generic/355 1s generic/356 [not run] swapfiles are not supported generic/357 [not run] swapfiles are not supported generic/358 [not run] Reflink not supported by scratch filesystem type: ceph generic/359 [not run] Reflink not supported by scratch filesystem type: ceph generic/360 1s generic/361 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/362 [not run] this test requires richacl support on $SCRATCH_DEV generic/363 [not run] this test requires richacl support on $SCRATCH_DEV generic/364 [not run] this test requires richacl support on $SCRATCH_DEV generic/365 [not run] this test requires richacl support on $SCRATCH_DEV generic/366 [not run] this test requires richacl support on $SCRATCH_DEV generic/367 [not run] this test requires richacl support on $SCRATCH_DEV generic/368 [not run] this test requires richacl support on $SCRATCH_DEV generic/369 [not run] this test requires richacl support on $SCRATCH_DEV generic/370 [not run] this test requires richacl support on $SCRATCH_DEV generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/372 [not run] Reflink not supported by scratch filesystem type: ceph generic/373 [not run] Reflink not supported by scratch filesystem type: ceph generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph generic/375 1s generic/376 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/377 2s generic/378 1s generic/379 [not run] disk quotas not supported by this filesystem type: ceph generic/380 [not run] disk quotas not supported by this filesystem type: ceph generic/381 [not run] disk quotas not supported by this filesystem type: ceph generic/382 [not run] disk quotas not supported by this filesystem type: ceph generic/383 [not run] disk quotas not supported by this filesystem type: ceph generic/384 [not run] disk quotas not supported by this filesystem type: ceph generic/385 [not run] disk quotas not supported by this filesystem type: ceph generic/386 [not run] disk quotas not supported by this filesystem type: ceph generic/389 [not run] O_TMPFILE is not supported generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/392 [not run] ceph does not support shutdown generic/393 2s generic/394 0s generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test generic/400 [not run] disk quotas not supported by this filesystem type: ceph generic/401 1s generic/402 [not run] filesystem ceph timestamp bounds are unknown generic/403 2s generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/406 4s generic/407 [not run] Reflink not supported by test filesystem type: ceph generic/408 [not run] Dedupe not supported by test filesystem type: ceph generic/409 [not run] require 172.21.15.6:6789:/scratch to be local device generic/410 [not run] require 172.21.15.6:6789:/scratch to be local device generic/411 [not run] require 172.21.15.6:6789:/scratch to be local device generic/412 1s generic/413 [not run] mount 172.21.15.6:6789:/scratch with dax failed generic/414 [not run] Reflink not supported by scratch filesystem type: ceph generic/417 [not run] ceph does not support shutdown generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/423 0s generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) generic/426 22s generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/428 0s generic/430 1s generic/431 0s generic/432 1s generic/433 1s generic/434 0s generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/437 1s generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test generic/441 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/443 0s generic/444 1s generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/448 1s generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/450 6s generic/451 30s generic/452 2s generic/453 [not run] ceph does not allow unrestricted byte streams for names generic/454 [not run] ceph does not allow unrestricted byte streams for names generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/458 [not run] Reflink not supported by scratch filesystem type: ceph generic/460 307s generic/462 [not run] mount 172.21.15.6:6789:/scratch with dax failed generic/463 [not run] Reflink not supported by test filesystem type: ceph generic/465 7s generic/466 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/467 3s generic/468 [not run] ceph does not support shutdown generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/470 [not run] This test requires a valid $LOGWRITES_DEV generic/471 37s generic/472 [not run] swapfiles are not supported generic/474 [not run] ceph does not support shutdown generic/477 5s generic/478 12s generic/479 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/480 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/481 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/483 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/484 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/486 1s generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/489 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/490 1s generic/491 [not run] ceph does not support freezing generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) generic/493 [not run] swapfiles are not supported generic/494 [not run] swapfiles are not supported generic/495 [not run] swapfiles are not supported generic/496 [not run] swapfiles are not supported generic/497 [not run] swapfiles are not supported generic/498 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/501 [not run] Reflink not supported by scratch filesystem type: ceph generic/502 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/504 1s generic/505 [not run] ceph does not support shutdown generic/506 [not run] disk quotas not supported by this filesystem type: ceph generic/507 [not run] file system doesn't support chattr +ASai generic/508 [not run] lsattr not supported by test filesystem type: ceph generic/509 [not run] O_TMPFILE is not supported generic/510 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/513 [not run] Reflink not supported by scratch filesystem type: ceph generic/514 [not run] Reflink not supported by scratch filesystem type: ceph generic/515 [not run] Reflink not supported by scratch filesystem type: ceph generic/516 [not run] Dedupe not supported by test filesystem type: ceph generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph generic/518 [not run] Reflink not supported by scratch filesystem type: ceph generic/519 [not run] FIBMAP not supported by this filesystem generic/520 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/523 1s generic/524 192s generic/525 [not run] filesystem does not support huge file size generic/526 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/527 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/528 0s generic/529 1s generic/530 [not run] ceph does not support shutdown generic/531 [not run] O_TMPFILE is not supported generic/532 0s generic/533 1s generic/534 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/535 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/536 [not run] ceph does not support shutdown generic/537 [not run] FSTRIM not supported generic/538 876s generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/540 [not run] Reflink not supported by scratch filesystem type: ceph generic/541 [not run] Reflink not supported by scratch filesystem type: ceph generic/542 [not run] Reflink not supported by scratch filesystem type: ceph generic/543 [not run] Reflink not supported by scratch filesystem type: ceph generic/544 [not run] Reflink not supported by scratch filesystem type: ceph generic/545 [not run] file system doesn't support chattr +i generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/547 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test generic/552 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) generic/554 [not run] swapfiles are not supported generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) generic/556 [not run] ceph does not support casefold feature generic/557 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/563 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/564 1s generic/565 1s generic/566 [not run] disk quotas not supported by this filesystem type: ceph generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/570 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/571 [not run] Require fcntl setlease support generic/572 [not run] fsverity utility required, skipped this test generic/573 [not run] fsverity utility required, skipped this test generic/574 [not run] fsverity utility required, skipped this test generic/575 [not run] fsverity utility required, skipped this test generic/576 [not run] fsverity utility required, skipped this test generic/577 [not run] fsverity utility required, skipped this test generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/587 [not run] disk quotas not supported by this filesystem type: ceph generic/588 [not run] Reflink not supported by scratch filesystem type: ceph generic/591 0s generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test generic/594 [not run] disk quotas not supported by this filesystem type: ceph generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test generic/596 [not run] file system doesn't support chattr +S generic/597 2s generic/598 1s generic/599 [not run] ceph does not support shutdown generic/600 [not run] disk quotas not supported by this filesystem type: ceph generic/601 [not run] disk quotas not supported by this filesystem type: ceph generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test generic/603 [not run] disk quotas not supported by this filesystem type: ceph generic/604 5s generic/605 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed generic/606 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) generic/608 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed generic/609 1s generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/611 1s generic/612 [not run] Reflink not supported by test filesystem type: ceph generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test generic/614 [not run] test requires delayed allocation buffered writes generic/618 1s generic/620 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test generic/623 [not run] ceph does not support shutdown generic/624 [not run] fsverity utility required, skipped this test generic/625 [not run] fsverity utility required, skipped this test generic/626 [not run] kernel doesn't support renameat2 syscall generic/628 [not run] Reflink not supported by scratch filesystem type: ceph generic/629 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph generic/632 2s generic/633 2s generic/634 2s generic/635 [not run] ceph does not support shutdown generic/636 [not run] swapfiles are not supported generic/637 1s generic/638 1s generic/639 1s generic/640 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/641 [not run] swapfiles are not supported generic/644 1s generic/645 119s generic/646 [not run] ceph does not support shutdown generic/647 1s generic/651 [not run] Reflink not supported by scratch filesystem type: ceph generic/652 [not run] Reflink not supported by scratch filesystem type: ceph generic/653 [not run] Reflink not supported by scratch filesystem type: ceph generic/654 [not run] Reflink not supported by scratch filesystem type: ceph generic/655 [not run] Reflink not supported by scratch filesystem type: ceph generic/657 [not run] Reflink not supported by scratch filesystem type: ceph generic/658 [not run] Reflink not supported by scratch filesystem type: ceph generic/659 [not run] Reflink not supported by scratch filesystem type: ceph generic/660 [not run] Reflink not supported by scratch filesystem type: ceph generic/661 [not run] Reflink not supported by scratch filesystem type: ceph generic/662 [not run] Reflink not supported by scratch filesystem type: ceph generic/663 [not run] Reflink not supported by scratch filesystem type: ceph generic/664 [not run] Reflink not supported by scratch filesystem type: ceph generic/665 [not run] Reflink not supported by scratch filesystem type: ceph generic/666 [not run] Reflink not supported by scratch filesystem type: ceph generic/667 [not run] Reflink not supported by scratch filesystem type: ceph generic/668 [not run] Reflink not supported by scratch filesystem type: ceph generic/669 [not run] Reflink not supported by scratch filesystem type: ceph generic/673 [not run] Reflink not supported by scratch filesystem type: ceph generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph generic/675 [not run] Reflink not supported by scratch filesystem type: ceph generic/676 800s generic/677 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/678 [not run] kernel does not support IO_URING generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/680 1s generic/681 [not run] disk quotas not supported by this filesystem type: ceph generic/682 [not run] disk quotas not supported by this filesystem type: ceph generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/689 1s generic/690 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/692 [not run] fsverity utility required, skipped this test generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test generic/695 [not run] require 172.21.15.6:6789:/scratch to be valid block disk generic/696 0s generic/697 1s generic/698 2s generic/699 [not run] overlayfs doesn't support idmappped layers generic/700 [not run] kernel doesn't support renameat2 syscall generic/702 [not run] Reflink not supported by scratch filesystem type: ceph generic/703 [not run] kernel does not support IO_URING generic/704 [not run] require 172.21.15.6:6789:/test to be valid block disk generic/706 1s generic/708 1s generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph generic/721 [not run] xfs_io startupdate support is missing generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/728 4s generic/729 1s generic/730 [not run] require 172.21.15.6:6789:/test to be valid block disk generic/731 [not run] require 172.21.15.6:6789:/test to be valid block disk generic/732 1s shared/002 [not run] not suitable for this filesystem type: ceph shared/032 [not run] not suitable for this filesystem type: ceph Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 shared/002 shared/032 Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 shared/002 shared/032 Failures: generic/317 Failed 1 of 598 tests 2023-12-19T15:14:00.079 INFO:tasks.cephfs.test_fscrypt:Command stderr - 2023-12-19T15:14:00.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo userdel --force --remove fsgqa 2023-12-19T15:14:00.274 INFO:teuthology.orchestra.run.smithi144.stderr:userdel: user fsgqa is currently used by process 305876 2023-12-19T15:14:01.070 DEBUG:teuthology.orchestra.run.smithi144:> sudo userdel --force --remove 123456-fsgqa 2023-12-19T15:14:01.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo groupdel fsgqa 2023-12-19T15:14:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:groupdel: group 'fsgqa' does not exist 2023-12-19T15:14:01.825 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-12-19T15:14:01.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:01.826 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.nnuPRzScSZxfstests-dev/results) 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: File: /tmp/tmp.nnuPRzScSZxfstests-dev/results 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 801h/2049d Inode: 416641 Links: 5 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-12-19 13:39:16.071316485 +0000 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-12-19 15:13:59.310367843 +0000 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-12-19 15:13:59.310367843 +0000 2023-12-19T15:14:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-12-19 13:39:16.071316485 +0000 2023-12-19T15:14:01.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:01.925 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-12-19T15:14:02.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:02.016 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.nnuPRzScSZxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-12-19T15:14:02.576 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.nnuPRzScSZxfstests-dev to /var/log/ceph. 2023-12-19T15:14:02.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf /tmp/tmp.nnuPRzScSZxfstests-dev 2023-12-19T15:14:03.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf /tmp/tmp.QMOkoB2Hnrxfsprogs-dev 2023-12-19T15:14:03.278 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T15:14:03.278 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T15:14:03.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T15:14:03.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T15:14:03.608 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T15:14:03.608 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T15:14:03.608 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T15:14:03.665 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T15:14:03.666 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T15:14:03.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T15:14:04.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.102+0000 7ff5ac7d9640 1 Processor -- start 2023-12-19T15:14:04.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.102+0000 7ff5ac7d9640 1 -- start start 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5ac7d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff5a40b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5ac7d9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40716b0 con 0x7ff5a406a120 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5ac7d9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40b4070 con 0x7ff5a4149260 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5ac7d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40b3430 con 0x7ff5a40b8150 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5a9d74640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5a406a120 0x7ff5a4148b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38568/0 (socket says 172.21.15.6:38568) 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5a9d74640 1 -- 172.21.15.6:0/3545529849 learned_addr learned my addr 172.21.15.6:0/3545529849 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5aa575640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff5a40b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755723549 0 0) 0x7ff5a40716b0 con 0x7ff5a406a120 2023-12-19T15:14:04.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.103+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff590003520 con 0x7ff5a406a120 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312107147 0 0) 0x7ff5a40b4070 con 0x7ff5a4149260 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a40716b0 con 0x7ff5a4149260 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 456905667 0 0) 0x7ff590003520 con 0x7ff5a406a120 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 msgr2=0x7ff5a40b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff5a40b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 >> v1:172.21.15.89:6789/0 conn(0x7ff5a4149260 legacy=0x7ff5a41532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40b58a0 con 0x7ff5a406a120 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7ff5940015f0 con 0x7ff5a406a120 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5aa575640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff5a40b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 >> v1:172.21.15.6:6789/0 conn(0x7ff5a406a120 legacy=0x7ff5a4148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff590003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5900040c0 0x7ff5900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff590004d00 0x7ff590005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40b3430 con 0x7ff5900040c0 2023-12-19T15:14:04.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bb40 con 0x7ff590004d00 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bd00 con 0x7ff5a40b8150 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5900040c0 0x7ff5900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5aad76640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff590004d00 0x7ff590005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5aa575640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff590003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9d74640 1 -- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 msgr2=0x7ff590003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a40b8150 0x7ff590003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9d74640 1 -- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff590004d00 msgr2=0x7ff590005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff590004d00 0x7ff590005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.104+0000 7ff5a9d74640 1 -- 172.21.15.6:0/3545529849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c009400 con 0x7ff5900040c0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.105+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5900040c0 0x7ff5900047c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff594007f10 tx=0x7ff5900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4fdfe7f8ab22d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.105+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594005ad0 con 0x7ff5900040c0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.105+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594005c30 con 0x7ff5900040c0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.105+0000 7ff5a9573640 1 -- 172.21.15.6:0/3545529849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594007070 con 0x7ff5900040c0 2023-12-19T15:14:04.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/3545529849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5900040c0 msgr2=0x7ff5900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/3545529849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5900040c0 0x7ff5900047c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff594007f10 tx=0x7ff5900057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5aad76640 1 -- 172.21.15.6:0/3545529849 reap_dead start 2023-12-19T15:14:04.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/3545529849 shutdown_connections 2023-12-19T15:14:04.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/3545529849 >> 172.21.15.6:0/3545529849 conn(0x7ff5a40bc330 msgr2=0x7ff5a40bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:04.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/3545529849 shutdown_connections 2023-12-19T15:14:04.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.106+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/3545529849 wait complete. 2023-12-19T15:14:04.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.107+0000 7ff5ac7d9640 1 Processor -- start 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.107+0000 7ff5ac7d9640 1 -- start start 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5ac7d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5900040c0 0x7ff5a4144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5ac7d9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 0x7ff5a41dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5ac7d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a41e02b0 0x7ff5a40b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5ac7d9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4145d60 con 0x7ff5a4149b00 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5ac7d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4144b50 con 0x7ff5900040c0 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5ac7d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41df970 con 0x7ff5a41e02b0 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 0x7ff5a41dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 0x7ff5a41dfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55276/0 (socket says 172.21.15.6:55276) 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 -- 172.21.15.6:0/1227657724 learned_addr learned my addr 172.21.15.6:0/1227657724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5aa575640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5900040c0 0x7ff5a4144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5aad76640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a41e02b0 0x7ff5a40b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 -- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a41e02b0 msgr2=0x7ff5a40b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a41e02b0 0x7ff5a40b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 -- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5900040c0 msgr2=0x7ff5a4144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5900040c0 0x7ff5a4144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 -- 172.21.15.6:0/1227657724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a414abb0 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.108+0000 7ff5a9d74640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 0x7ff5a41dfd70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff59402c280 tx=0x7ff5940018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.109+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594005e70 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.109+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594005a40 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.109+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a41df620 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.109+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59402c920 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.109+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4145f40 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.110+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a40b3d10 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.110+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff594032070 con 0x7ff5a4149b00 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.111+0000 7ff59affd640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff58806a430 0x7ff58806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.111+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff59403c040 con 0x7ff5a4149b00 2023-12-19T15:14:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.111+0000 7ff5aa575640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff58806a430 0x7ff58806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.111+0000 7ff5aa575640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff58806a430 0x7ff58806c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009c60 tx=0x7ff59c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.115+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5940752a0 con 0x7ff5a4149b00 2023-12-19T15:14:04.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.292+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a4073a40 con 0x7ff5a4149b00 2023-12-19T15:14:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.293+0000 7ff59affd640 1 -- 172.21.15.6:0/1227657724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16005 (secure 0 0 0) 0x7ff594045090 con 0x7ff5a4149b00 2023-12-19T15:14:04.293 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:04.293 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:49.344731+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T15:14:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff58806a430 msgr2=0x7ff58806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff58806a430 0x7ff58806c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009c60 tx=0x7ff59c009190 comp rx=0 tx=0).stop 2023-12-19T15:14:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 msgr2=0x7ff5a41dfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 0x7ff5a41dfd70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff59402c280 tx=0x7ff5940018b0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 shutdown_connections 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff58806a430 0x7ff58806c8f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5a41e02b0 0x7ff5a40b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5a4149b00 0x7ff5a41dfd70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 --2- 172.21.15.6:0/1227657724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5900040c0 0x7ff5a4144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 >> 172.21.15.6:0/1227657724 conn(0x7ff5a40bc330 msgr2=0x7ff5a40b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 shutdown_connections 2023-12-19T15:14:04.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.295+0000 7ff5ac7d9640 1 -- 172.21.15.6:0/1227657724 wait complete. 2023-12-19T15:14:04.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:46.060812+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:47.322637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T15:14:04.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T15:14:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.415+0000 7fea9f65f640 1 Processor -- start 2023-12-19T15:14:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.415+0000 7fea9f65f640 1 -- start start 2023-12-19T15:14:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9f65f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea980b7a40 0x7fea980b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9f65f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea980bad10 0x7fea9814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9f65f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9814b930 con 0x7fea981410f0 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9f65f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980b8da0 con 0x7fea980b7a40 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9f65f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980b9ea0 con 0x7fea980bad10 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea980b7a40 0x7fea980b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea980b7a40 0x7fea980b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55286/0 (socket says 172.21.15.6:55286) 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 -- 172.21.15.6:0/3134463732 learned_addr learned my addr 172.21.15.6:0/3134463732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9cbfa640 1 --2- 172.21.15.6:0/3134463732 >> v2:172.21.15.89:3300/0 conn(0x7fea980bad10 0x7fea9814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 -- 172.21.15.6:0/3134463732 >> v2:172.21.15.89:3300/0 conn(0x7fea980bad10 msgr2=0x7fea9814b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 --2- 172.21.15.6:0/3134463732 >> v2:172.21.15.89:3300/0 conn(0x7fea980bad10 0x7fea9814b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 -- 172.21.15.6:0/3134463732 >> v1:172.21.15.89:6789/0 conn(0x7fea981410f0 legacy=0x7fea9814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.416+0000 7fea9d3fb640 1 -- 172.21.15.6:0/3134463732 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980b8ac0 con 0x7fea980b7a40 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.417+0000 7fea9d3fb640 1 --2- 172.21.15.6:0/3134463732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980b7a40 0x7fea980b83f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fea980668c0 tx=0x7fea8802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd9175dcbb95146 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.417+0000 7fea8ffff640 1 -- 172.21.15.6:0/3134463732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8802f850 con 0x7fea980b7a40 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.417+0000 7fea8ffff640 1 -- 172.21.15.6:0/3134463732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8802f9b0 con 0x7fea980b7a40 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.417+0000 7fea8ffff640 1 -- 172.21.15.6:0/3134463732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8802fd40 con 0x7fea980b7a40 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 -- 172.21.15.6:0/3134463732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980b7a40 msgr2=0x7fea980b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 --2- 172.21.15.6:0/3134463732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980b7a40 0x7fea980b83f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fea980668c0 tx=0x7fea8802ba30 comp rx=0 tx=0).stop 2023-12-19T15:14:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 -- 172.21.15.6:0/3134463732 shutdown_connections 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 --2- 172.21.15.6:0/3134463732 >> v2:172.21.15.89:3300/0 conn(0x7fea980bad10 0x7fea9814b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 --2- 172.21.15.6:0/3134463732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980b7a40 0x7fea980b83f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 -- 172.21.15.6:0/3134463732 >> 172.21.15.6:0/3134463732 conn(0x7fea980c0390 msgr2=0x7fea980c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 -- 172.21.15.6:0/3134463732 shutdown_connections 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.418+0000 7fea9f65f640 1 -- 172.21.15.6:0/3134463732 wait complete. 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.419+0000 7fea9f65f640 1 Processor -- start 2023-12-19T15:14:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.419+0000 7fea9f65f640 1 -- start start 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9f65f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea980b7a40 0x7fea981e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9f65f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 0x7fea981e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9f65f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea981410f0 0x7fea98137d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9f65f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9814bd40 con 0x7fea980bad10 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9f65f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98138270 con 0x7fea981410f0 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9f65f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea98138a10 con 0x7fea980b7a40 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 0x7fea981e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 0x7fea981e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55302/0 (socket says 172.21.15.6:55302) 2023-12-19T15:14:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 -- 172.21.15.6:0/464021112 learned_addr learned my addr 172.21.15.6:0/464021112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9d3fb640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea980b7a40 0x7fea981e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9dbfc640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea981410f0 0x7fea98137d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 -- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea980b7a40 msgr2=0x7fea981e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea980b7a40 0x7fea981e7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 -- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea981410f0 msgr2=0x7fea98137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea981410f0 0x7fea98137d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.420+0000 7fea9cbfa640 1 -- 172.21.15.6:0/464021112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880094d0 con 0x7fea980bad10 2023-12-19T15:14:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.421+0000 7fea9cbfa640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 0x7fea981e3f60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9b0 tx=0x7fea9400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.421+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94009670 con 0x7fea980bad10 2023-12-19T15:14:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.421+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400c9a0 con 0x7fea980bad10 2023-12-19T15:14:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.421+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400cd30 con 0x7fea980bad10 2023-12-19T15:14:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.421+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea981365b0 con 0x7fea980bad10 2023-12-19T15:14:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.421+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea981e7a80 con 0x7fea980bad10 2023-12-19T15:14:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.422+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea98138870 con 0x7fea980bad10 2023-12-19T15:14:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.422+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea94013470 con 0x7fea980bad10 2023-12-19T15:14:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.423+0000 7fea8dffb640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fea7c06a430 0x7fea7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.423+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea94088a50 con 0x7fea980bad10 2023-12-19T15:14:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.423+0000 7fea9d3fb640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fea7c06a430 0x7fea7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.424+0000 7fea9d3fb640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fea7c06a430 0x7fea7c06c8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea88036000 tx=0x7fea88008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.427+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea98138870 con 0x7fea980bad10 2023-12-19T15:14:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.603+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea98138870 con 0x7fea980bad10 2023-12-19T15:14:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.603+0000 7fea8dffb640 1 -- 172.21.15.6:0/464021112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea98138870 con 0x7fea980bad10 2023-12-19T15:14:04.604 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fea7c06a430 msgr2=0x7fea7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fea7c06a430 0x7fea7c06c8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea88036000 tx=0x7fea88008030 comp rx=0 tx=0).stop 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 msgr2=0x7fea981e3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 0x7fea981e3f60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9b0 tx=0x7fea9400ee70 comp rx=0 tx=0).stop 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 shutdown_connections 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fea7c06a430 0x7fea7c06c8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea981410f0 0x7fea98137d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980bad10 0x7fea981e3f60 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 --2- 172.21.15.6:0/464021112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea980b7a40 0x7fea981e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 >> 172.21.15.6:0/464021112 conn(0x7fea980c0390 msgr2=0x7fea9813b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 shutdown_connections 2023-12-19T15:14:04.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.605+0000 7fea9f65f640 1 -- 172.21.15.6:0/464021112 wait complete. 2023-12-19T15:14:04.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T15:14:04.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.726+0000 7f708efd2640 1 Processor -- start 2023-12-19T15:14:04.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.726+0000 7f708efd2640 1 -- start start 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.726+0000 7f708efd2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7088142f20 0x7f70880b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.726+0000 7f708efd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70881498f0 con 0x7f70880b94b0 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.726+0000 7f708efd2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088148fc0 con 0x7f70880a0cc0 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.726+0000 7f708efd2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880b37e0 con 0x7f7088142f20 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f708d56f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f70880b94b0 0x7f7088153280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38574/0 (socket says 172.21.15.6:38574) 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f708d56f640 1 -- 172.21.15.6:0/861652675 learned_addr learned my addr 172.21.15.6:0/861652675 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f708cd6e640 1 --2- 172.21.15.6:0/861652675 >> v2:172.21.15.89:3300/0 conn(0x7f7088142f20 0x7f70880b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072605743 0 0) 0x7f70881498f0 con 0x7f70880b94b0 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7078003520 con 0x7f70880b94b0 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042910648 0 0) 0x7f7078003520 con 0x7f70880b94b0 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 >> v2:172.21.15.89:3300/0 conn(0x7f7088142f20 msgr2=0x7f70880b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 --2- 172.21.15.6:0/861652675 >> v2:172.21.15.89:3300/0 conn(0x7f7088142f20 0x7f70880b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 >> v1:172.21.15.89:6789/0 conn(0x7f70880a0cc0 legacy=0x7f70880b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70881492a0 con 0x7f70880b94b0 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f7080001a40 con 0x7f70880b94b0 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f708cd6e640 1 --2- 172.21.15.6:0/861652675 >> v2:172.21.15.89:3300/0 conn(0x7f7088142f20 0x7f70880b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 >> v1:172.21.15.6:6789/0 conn(0x7f70880b94b0 legacy=0x7f7088153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078003970 0x7f7078003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70780047c0 0x7f7078004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7078005180 0x7f707800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880b37e0 con 0x7f7078005180 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c030 con 0x7f70780047c0 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c1f0 con 0x7f7078003970 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.727+0000 7f708d56f640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7078005180 0x7f707800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708cd6e640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078003970 0x7f7078003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f7087fff640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70780047c0 0x7f7078004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708d56f640 1 -- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078003970 msgr2=0x7f7078003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708d56f640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078003970 0x7f7078003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708d56f640 1 -- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70780047c0 msgr2=0x7f7078004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708d56f640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70780047c0 0x7f7078004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708d56f640 1 -- 172.21.15.6:0/861652675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078003520 con 0x7f7078005180 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.728+0000 7f708d56f640 1 -- 172.21.15.6:0/861652675 reap_dead start 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708d56f640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7078005180 0x7f707800b980 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f708000a7a0 tx=0x7f70780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3b2fc4c88e0bf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080034630 con 0x7f7078005180 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708002f070 con 0x7f7078005180 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f70877fe640 1 -- 172.21.15.6:0/861652675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800349b0 con 0x7f7078005180 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 -- 172.21.15.6:0/861652675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7078005180 msgr2=0x7f707800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7078005180 0x7f707800b980 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f708000a7a0 tx=0x7f70780057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 -- 172.21.15.6:0/861652675 shutdown_connections 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 --2- 172.21.15.6:0/861652675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7078005180 0x7f707800b980 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 -- 172.21.15.6:0/861652675 >> 172.21.15.6:0/861652675 conn(0x7f70880be1e0 msgr2=0x7f70880be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 -- 172.21.15.6:0/861652675 shutdown_connections 2023-12-19T15:14:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.729+0000 7f708efd2640 1 -- 172.21.15.6:0/861652675 wait complete. 2023-12-19T15:14:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.730+0000 7f708efd2640 1 Processor -- start 2023-12-19T15:14:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.730+0000 7f708efd2640 1 -- start start 2023-12-19T15:14:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708efd2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078005180 0x7f7088149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708efd2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70880a29f0 0x7f70881dde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708efd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 0x7f708806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708efd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708814ab90 con 0x7f708806ea20 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708efd2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70881d85e0 con 0x7f70880a29f0 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708efd2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880a1270 con 0x7f7078005180 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708d56f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 0x7f708806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708d56f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 0x7f708806eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55324/0 (socket says 172.21.15.6:55324) 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708d56f640 1 -- 172.21.15.6:0/1245444573 learned_addr learned my addr 172.21.15.6:0/1245444573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f7087fff640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70880a29f0 0x7f70881dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.731+0000 7f708cd6e640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078005180 0x7f7088149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708d56f640 1 -- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078005180 msgr2=0x7f7088149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708d56f640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078005180 0x7f7088149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708d56f640 1 -- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70880a29f0 msgr2=0x7f70881dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708d56f640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70880a29f0 0x7f70881dde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708d56f640 1 -- 172.21.15.6:0/1245444573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880a2e50 con 0x7f708806ea20 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f7087fff640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70880a29f0 0x7f70881dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708d56f640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 0x7f708806eea0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f708000a7a0 tx=0x7f70880b5410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080001a00 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7080001b60 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70881de670 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708003f690 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.732+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70881dec30 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.733+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7088066e90 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.734+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7080031030 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.734+0000 7f70857fa640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f706c06a430 0x7f706c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.734+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70800a9e20 con 0x7f708806ea20 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.734+0000 7f708cd6e640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f706c06a430 0x7f706c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.735+0000 7f708cd6e640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f706c06a430 0x7f706c06c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f707c009c10 tx=0x7f707c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:04.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.738+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70800754a0 con 0x7f708806ea20 2023-12-19T15:14:04.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.920+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7088066e90 con 0x7f708806ea20 2023-12-19T15:14:04.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.920+0000 7f70857fa640 1 -- 172.21.15.6:0/1245444573 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7080044020 con 0x7f708806ea20 2023-12-19T15:14:04.921 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T15:14:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f706c06a430 msgr2=0x7f706c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f706c06a430 0x7f706c06c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f707c009c10 tx=0x7f707c008040 comp rx=0 tx=0).stop 2023-12-19T15:14:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 msgr2=0x7f708806eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 0x7f708806eea0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f708000a7a0 tx=0x7f70880b5410 comp rx=0 tx=0).stop 2023-12-19T15:14:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 shutdown_connections 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f706c06a430 0x7f706c06c8f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708806ea20 0x7f708806eea0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70880a29f0 0x7f70881dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 --2- 172.21.15.6:0/1245444573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7078005180 0x7f7088149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 >> 172.21.15.6:0/1245444573 conn(0x7f70880be1e0 msgr2=0x7f708813b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 shutdown_connections 2023-12-19T15:14:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:04.922+0000 7f708efd2640 1 -- 172.21.15.6:0/1245444573 wait complete. 2023-12-19T15:14:04.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T15:14:05.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.042+0000 7f89db4ec640 1 Processor -- start 2023-12-19T15:14:05.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.042+0000 7f89db4ec640 1 -- start start 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89db4ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d40b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89db4ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89d40b94b0 0x7f89d4153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89db4ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d41498f0 con 0x7f89d40a0cc0 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89db4ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d40b37e0 con 0x7f89d40b94b0 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89db4ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d4148fc0 con 0x7f89d4142f20 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89d9288640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d40b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89d9288640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d40b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:51796/0 (socket says 172.21.15.6:51796) 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89d9288640 1 -- 172.21.15.6:0/2008136472 learned_addr learned my addr 172.21.15.6:0/2008136472 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89d8a87640 1 --1- 172.21.15.6:0/2008136472 >> v1:172.21.15.89:6789/0 conn(0x7f89d40a0cc0 0x7f89d40b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:57480/0 (socket says 172.21.15.6:57480) 2023-12-19T15:14:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.043+0000 7f89d9a89640 1 --2- 172.21.15.6:0/2008136472 >> v2:172.21.15.89:3300/0 conn(0x7f89d40b94b0 0x7f89d4153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.044+0000 7f89cbfff640 1 -- 172.21.15.6:0/2008136472 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293424069 0 0) 0x7f89d41498f0 con 0x7f89d40a0cc0 2023-12-19T15:14:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.044+0000 7f89d9288640 1 -- 172.21.15.6:0/2008136472 >> v2:172.21.15.89:3300/0 conn(0x7f89d40b94b0 msgr2=0x7f89d4153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.044+0000 7f89d9288640 1 --2- 172.21.15.6:0/2008136472 >> v2:172.21.15.89:3300/0 conn(0x7f89d40b94b0 0x7f89d4153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.044+0000 7f89d9288640 1 -- 172.21.15.6:0/2008136472 >> v1:172.21.15.89:6789/0 conn(0x7f89d40a0cc0 legacy=0x7f89d40b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.044+0000 7f89d9288640 1 -- 172.21.15.6:0/2008136472 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d41492a0 con 0x7f89d4142f20 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.044+0000 7f89d9288640 1 --2- 172.21.15.6:0/2008136472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d40b4290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009870 tx=0x7f89d002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c99e960a6eb8f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89cbfff640 1 -- 172.21.15.6:0/2008136472 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d002f840 con 0x7f89d4142f20 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89cbfff640 1 -- 172.21.15.6:0/2008136472 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d002f9a0 con 0x7f89d4142f20 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89cbfff640 1 -- 172.21.15.6:0/2008136472 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d002fd30 con 0x7f89d4142f20 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 -- 172.21.15.6:0/2008136472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 msgr2=0x7f89d40b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 --2- 172.21.15.6:0/2008136472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d40b4290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009870 tx=0x7f89d002ba20 comp rx=0 tx=0).stop 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 -- 172.21.15.6:0/2008136472 shutdown_connections 2023-12-19T15:14:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 --2- 172.21.15.6:0/2008136472 >> v2:172.21.15.89:3300/0 conn(0x7f89d40b94b0 0x7f89d4153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 --2- 172.21.15.6:0/2008136472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d40b4290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 -- 172.21.15.6:0/2008136472 >> 172.21.15.6:0/2008136472 conn(0x7f89d40be1e0 msgr2=0x7f89d40be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.045+0000 7f89db4ec640 1 -- 172.21.15.6:0/2008136472 shutdown_connections 2023-12-19T15:14:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.046+0000 7f89db4ec640 1 -- 172.21.15.6:0/2008136472 wait complete. 2023-12-19T15:14:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.047+0000 7f89db4ec640 1 Processor -- start 2023-12-19T15:14:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.047+0000 7f89db4ec640 1 -- start start 2023-12-19T15:14:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89db4ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d40a0cc0 0x7f89d4139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89db4ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 0x7f89d41e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89db4ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d4133470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89db4ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d413a2a0 con 0x7f89d40b94b0 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89db4ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d406f1f0 con 0x7f89d40a0cc0 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89db4ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d41e3ee0 con 0x7f89d4142f20 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89d8a87640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 0x7f89d41e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89d8a87640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 0x7f89d41e4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55336/0 (socket says 172.21.15.6:55336) 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89d8a87640 1 -- 172.21.15.6:0/3587030754 learned_addr learned my addr 172.21.15.6:0/3587030754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89d9288640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d40a0cc0 0x7f89d4139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.048+0000 7f89d9a89640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d4133470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d8a87640 1 -- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 msgr2=0x7f89d4133470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d8a87640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d4133470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d8a87640 1 -- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d40a0cc0 msgr2=0x7f89d4139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d8a87640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d40a0cc0 0x7f89d4139d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d8a87640 1 -- 172.21.15.6:0/3587030754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00094d0 con 0x7f89d40b94b0 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d9288640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d40a0cc0 0x7f89d4139d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89d8a87640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 0x7f89d41e4370 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f89c400c4b0 tx=0x7f89c400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40074e0 con 0x7f89d40b94b0 2023-12-19T15:14:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c4007660 con 0x7f89d40b94b0 2023-12-19T15:14:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d41e48b0 con 0x7f89d40b94b0 2023-12-19T15:14:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4004a20 con 0x7f89d40b94b0 2023-12-19T15:14:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.049+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d41e3b70 con 0x7f89d40b94b0 2023-12-19T15:14:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.050+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d4066e90 con 0x7f89d40b94b0 2023-12-19T15:14:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.050+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89c4004b80 con 0x7f89d40b94b0 2023-12-19T15:14:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.051+0000 7f89c9ffb640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89b806a430 0x7f89b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.051+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89c4087a90 con 0x7f89d40b94b0 2023-12-19T15:14:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.051+0000 7f89d9288640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89b806a430 0x7f89b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.052+0000 7f89d9288640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89b806a430 0x7f89b806c8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89d0036000 tx=0x7f89d0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.056+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89c4053140 con 0x7f89d40b94b0 2023-12-19T15:14:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.233+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89d41e4050 con 0x7f89d40b94b0 2023-12-19T15:14:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.233+0000 7f89c9ffb640 1 -- 172.21.15.6:0/3587030754 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89c4018020 con 0x7f89d40b94b0 2023-12-19T15:14:05.234 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.235+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89b806a430 msgr2=0x7f89b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.235+0000 7f89db4ec640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89b806a430 0x7f89b806c8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89d0036000 tx=0x7f89d0008030 comp rx=0 tx=0).stop 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 msgr2=0x7f89d41e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 0x7f89d41e4370 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f89c400c4b0 tx=0x7f89c400c970 comp rx=0 tx=0).stop 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 shutdown_connections 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f89b806a430 0x7f89b806c8f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89d4142f20 0x7f89d4133470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40b94b0 0x7f89d41e4370 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 --2- 172.21.15.6:0/3587030754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d40a0cc0 0x7f89d4139d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 >> 172.21.15.6:0/3587030754 conn(0x7f89d40be1e0 msgr2=0x7f89d4140740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 shutdown_connections 2023-12-19T15:14:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.236+0000 7f89db4ec640 1 -- 172.21.15.6:0/3587030754 wait complete. 2023-12-19T15:14:05.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T15:14:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.355+0000 7f5a99626640 1 Processor -- start 2023-12-19T15:14:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.355+0000 7f5a99626640 1 -- start start 2023-12-19T15:14:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a99626640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 0x7f5a940bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a99626640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a94140ef0 0x7f5a94141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a99626640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a941418c0 con 0x7f5a940b79f0 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a99626640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940bbca0 con 0x7f5a94140ef0 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a99626640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940bacc0 con 0x7f5a9414aa00 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 0x7f5a940bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a937fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a94140ef0 0x7f5a94141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 0x7f5a940bb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:51812/0 (socket says 172.21.15.6:51812) 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 -- 172.21.15.6:0/2719634890 learned_addr learned my addr 172.21.15.6:0/2719634890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 -- 172.21.15.6:0/2719634890 >> v2:172.21.15.89:3300/0 conn(0x7f5a94140ef0 msgr2=0x7f5a94141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 --2- 172.21.15.6:0/2719634890 >> v2:172.21.15.89:3300/0 conn(0x7f5a94140ef0 0x7f5a94141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 -- 172.21.15.6:0/2719634890 >> v1:172.21.15.89:6789/0 conn(0x7f5a940b79f0 legacy=0x7f5a940b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.356+0000 7f5a927fc640 1 -- 172.21.15.6:0/2719634890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a940bbe60 con 0x7f5a9414aa00 2023-12-19T15:14:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.357+0000 7f5a927fc640 1 --2- 172.21.15.6:0/2719634890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 0x7f5a940bb760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009870 tx=0x7f5a8402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff8fea108464f93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.357+0000 7f5a91ffb640 1 -- 172.21.15.6:0/2719634890 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8402f840 con 0x7f5a9414aa00 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.357+0000 7f5a91ffb640 1 -- 172.21.15.6:0/2719634890 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8402f9a0 con 0x7f5a9414aa00 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.357+0000 7f5a91ffb640 1 -- 172.21.15.6:0/2719634890 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8402fd30 con 0x7f5a9414aa00 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 -- 172.21.15.6:0/2719634890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 msgr2=0x7f5a940bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 --2- 172.21.15.6:0/2719634890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 0x7f5a940bb760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009870 tx=0x7f5a8402ba20 comp rx=0 tx=0).stop 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 -- 172.21.15.6:0/2719634890 shutdown_connections 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 --2- 172.21.15.6:0/2719634890 >> v2:172.21.15.89:3300/0 conn(0x7f5a94140ef0 0x7f5a94141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 --2- 172.21.15.6:0/2719634890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a9414aa00 0x7f5a940bb760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 -- 172.21.15.6:0/2719634890 >> 172.21.15.6:0/2719634890 conn(0x7f5a940c0340 msgr2=0x7f5a940c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 -- 172.21.15.6:0/2719634890 shutdown_connections 2023-12-19T15:14:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.358+0000 7f5a99626640 1 -- 172.21.15.6:0/2719634890 wait complete. 2023-12-19T15:14:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.359+0000 7f5a99626640 1 Processor -- start 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.359+0000 7f5a99626640 1 -- start start 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a99626640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b79f0 0x7f5a94146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a99626640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94140ef0 0x7f5a940bf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a99626640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 0x7f5a941e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a99626640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940bfe30 con 0x7f5a9414aa00 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a99626640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a941e3550 con 0x7f5a94140ef0 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a99626640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a941471a0 con 0x7f5a940b79f0 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 0x7f5a941e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 0x7f5a941e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55352/0 (socket says 172.21.15.6:55352) 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 -- 172.21.15.6:0/2243020444 learned_addr learned my addr 172.21.15.6:0/2243020444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a92ffd640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b79f0 0x7f5a94146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a927fc640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94140ef0 0x7f5a940bf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 -- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b79f0 msgr2=0x7f5a94146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b79f0 0x7f5a94146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 -- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94140ef0 msgr2=0x7f5a940bf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94140ef0 0x7f5a940bf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a937fe640 1 -- 172.21.15.6:0/2243020444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840094d0 con 0x7f5a9414aa00 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.360+0000 7f5a927fc640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94140ef0 0x7f5a940bf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.361+0000 7f5a937fe640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 0x7f5a941e39e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00efc0 tx=0x7f5a8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.361+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c014480 con 0x7f5a9414aa00 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.361+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c00f040 con 0x7f5a9414aa00 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.361+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a940c0100 con 0x7f5a9414aa00 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.361+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c014820 con 0x7f5a9414aa00 2023-12-19T15:14:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.361+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a94147d40 con 0x7f5a9414aa00 2023-12-19T15:14:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.362+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a941e36c0 con 0x7f5a9414aa00 2023-12-19T15:14:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.362+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a8c014980 con 0x7f5a9414aa00 2023-12-19T15:14:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.363+0000 7f5a8b7fe640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a7406a460 0x7f5a7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.363+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a8c089640 con 0x7f5a9414aa00 2023-12-19T15:14:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.363+0000 7f5a92ffd640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a7406a460 0x7f5a7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.364+0000 7f5a92ffd640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a7406a460 0x7f5a7406c920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c000f60 tx=0x7f5a7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.367+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a8c054d70 con 0x7f5a9414aa00 2023-12-19T15:14:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.556+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a94073a40 con 0x7f5a9414aa00 2023-12-19T15:14:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.557+0000 7f5a8b7fe640 1 -- 172.21.15.6:0/2243020444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5a8c058390 con 0x7f5a9414aa00 2023-12-19T15:14:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a7406a460 msgr2=0x7f5a7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a7406a460 0x7f5a7406c920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c000f60 tx=0x7f5a7c009040 comp rx=0 tx=0).stop 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 msgr2=0x7f5a941e39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 0x7f5a941e39e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00efc0 tx=0x7f5a8c00c490 comp rx=0 tx=0).stop 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 shutdown_connections 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5a7406a460 0x7f5a7406c920 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9414aa00 0x7f5a941e39e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94140ef0 0x7f5a940bf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 --2- 172.21.15.6:0/2243020444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b79f0 0x7f5a94146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 >> 172.21.15.6:0/2243020444 conn(0x7f5a940c0340 msgr2=0x7f5a9413c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 shutdown_connections 2023-12-19T15:14:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.559+0000 7f5a99626640 1 -- 172.21.15.6:0/2243020444 wait complete. 2023-12-19T15:14:05.569 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T15:14:05.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:05.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T15:14:05.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-12-19T15:14:05.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:05.684 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T15:14:05.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T15:14:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.863+0000 7f9da5ee5640 1 Processor -- start 2023-12-19T15:14:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.863+0000 7f9da5ee5640 1 -- start start 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9da5ee5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9da0145110 0x7f9da0070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9da5ee5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 0x7f9da01554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9da5ee5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da014bbe0 con 0x7f9da0069d00 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9da5ee5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00b7230 con 0x7f9da0145110 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9da5ee5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da014b750 con 0x7f9da006a170 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 0x7f9da01554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 0x7f9da01554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:51830/0 (socket says 172.21.15.6:51830) 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9d9ffff640 1 -- 172.21.15.6:0/4018053630 learned_addr learned my addr 172.21.15.6:0/4018053630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.864+0000 7f9d9f7fe640 1 --2- 172.21.15.6:0/4018053630 >> v2:172.21.15.89:3300/0 conn(0x7f9da0145110 0x7f9da0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.865+0000 7f9d9ffff640 1 -- 172.21.15.6:0/4018053630 >> v2:172.21.15.89:3300/0 conn(0x7f9da0145110 msgr2=0x7f9da0070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.865+0000 7f9d9ffff640 1 --2- 172.21.15.6:0/4018053630 >> v2:172.21.15.89:3300/0 conn(0x7f9da0145110 0x7f9da0070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.865+0000 7f9d9ffff640 1 -- 172.21.15.6:0/4018053630 >> v1:172.21.15.89:6789/0 conn(0x7f9da0069d00 legacy=0x7f9da00b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.865+0000 7f9d9ffff640 1 -- 172.21.15.6:0/4018053630 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da014ae20 con 0x7f9da006a170 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.865+0000 7f9d9ffff640 1 --2- 172.21.15.6:0/4018053630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 0x7f9da01554b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009e50 tx=0x7f9d9802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e545e01e07e5dffc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.865+0000 7f9d9e7fc640 1 -- 172.21.15.6:0/4018053630 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9802ca70 con 0x7f9da006a170 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9d9e7fc640 1 -- 172.21.15.6:0/4018053630 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9802cbd0 con 0x7f9da006a170 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9d9e7fc640 1 -- 172.21.15.6:0/4018053630 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980343f0 con 0x7f9da006a170 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 -- 172.21.15.6:0/4018053630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 msgr2=0x7f9da01554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/4018053630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 0x7f9da01554b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009e50 tx=0x7f9d9802bed0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 -- 172.21.15.6:0/4018053630 shutdown_connections 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/4018053630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da006a170 0x7f9da01554b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/4018053630 >> v2:172.21.15.89:3300/0 conn(0x7f9da0145110 0x7f9da0070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 -- 172.21.15.6:0/4018053630 >> 172.21.15.6:0/4018053630 conn(0x7f9da00bd060 msgr2=0x7f9da00bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 -- 172.21.15.6:0/4018053630 shutdown_connections 2023-12-19T15:14:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.866+0000 7f9da5ee5640 1 -- 172.21.15.6:0/4018053630 wait complete. 2023-12-19T15:14:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.867+0000 7f9da5ee5640 1 Processor -- start 2023-12-19T15:14:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.867+0000 7f9da5ee5640 1 -- start start 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9da5ee5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 0x7f9da00b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9da5ee5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9da006a170 0x7f9da0146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9da5ee5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da0145110 0x7f9da01475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9da5ee5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b5db0 con 0x7f9da0069d00 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9da5ee5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0143ca0 con 0x7f9da006a170 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9da5ee5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0146c70 con 0x7f9da0145110 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 0x7f9da00b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 0x7f9da00b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55368/0 (socket says 172.21.15.6:55368) 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 -- 172.21.15.6:0/2918415245 learned_addr learned my addr 172.21.15.6:0/2918415245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9ffff640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da0145110 0x7f9da01475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9effd640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9da006a170 0x7f9da0146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 -- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da0145110 msgr2=0x7f9da01475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da0145110 0x7f9da01475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 -- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9da006a170 msgr2=0x7f9da0146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.868+0000 7f9d9f7fe640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9da006a170 0x7f9da0146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9d9f7fe640 1 -- 172.21.15.6:0/2918415245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98009b30 con 0x7f9da0069d00 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9d9f7fe640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 0x7f9da00b5870 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000e9b0 tx=0x7f9d9000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90009670 con 0x7f9da0069d00 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000c9a0 con 0x7f9da0069d00 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000cd50 con 0x7f9da0069d00 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da0143eb0 con 0x7f9da0069d00 2023-12-19T15:14:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.869+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0145c70 con 0x7f9da0069d00 2023-12-19T15:14:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.870+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0071630 con 0x7f9da0069d00 2023-12-19T15:14:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.870+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d90013470 con 0x7f9da0069d00 2023-12-19T15:14:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.871+0000 7f9d97fff640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9d8006a460 0x7f9d8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.871+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d90088a60 con 0x7f9da0069d00 2023-12-19T15:14:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.871+0000 7f9d9effd640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9d8006a460 0x7f9d8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.872+0000 7f9d9effd640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9d8006a460 0x7f9d8006c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9da00b8b60 tx=0x7f9d88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:05.875+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d90054190 con 0x7f9da0069d00 2023-12-19T15:14:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.090+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9da0073a40 con 0x7f9da0069d00 2023-12-19T15:14:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.090+0000 7f9d97fff640 1 -- 172.21.15.6:0/2918415245 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3882 (secure 0 0 0) 0x7f9d90017090 con 0x7f9da0069d00 2023-12-19T15:14:06.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:06.091 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:48.343293+0000","modified":"2023-12-19T13:33:50.971099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/331533137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":331533137},{"type":"v1","addr":"172.21.15.6:6835","nonce":331533137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T15:14:06.091 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2023-12-19T15:14:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9d8006a460 msgr2=0x7f9d8006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9d8006a460 0x7f9d8006c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9da00b8b60 tx=0x7f9d88009040 comp rx=0 tx=0).stop 2023-12-19T15:14:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 msgr2=0x7f9da00b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 0x7f9da00b5870 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000e9b0 tx=0x7f9d9000ee70 comp rx=0 tx=0).stop 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 shutdown_connections 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9d8006a460 0x7f9d8006c920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9da0145110 0x7f9da01475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9da006a170 0x7f9da0146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 --2- 172.21.15.6:0/2918415245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da0069d00 0x7f9da00b5870 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 >> 172.21.15.6:0/2918415245 conn(0x7f9da00bd060 msgr2=0x7f9da00bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 shutdown_connections 2023-12-19T15:14:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.092+0000 7f9da5ee5640 1 -- 172.21.15.6:0/2918415245 wait complete. 2023-12-19T15:14:06.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T15:14:06.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 Processor -- start 2023-12-19T15:14:06.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 -- start start 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec06a6d0 0x7fc6ec14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6ec14b1f0 0x7fc6ec0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0bb310 con 0x7fc6ec0ba550 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec0bf960 con 0x7fc6ec06a6d0 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6f14ad640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec0bb5b0 con 0x7fc6ec14b1f0 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6eaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec06a6d0 0x7fc6ec14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6eaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec06a6d0 0x7fc6ec14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55382/0 (socket says 172.21.15.6:55382) 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.209+0000 7fc6eaffd640 1 -- 172.21.15.6:0/2518364199 learned_addr learned my addr 172.21.15.6:0/2518364199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.210+0000 7fc6ea7fc640 1 --2- 172.21.15.6:0/2518364199 >> v2:172.21.15.89:3300/0 conn(0x7fc6ec14b1f0 0x7fc6ec0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.210+0000 7fc6eaffd640 1 -- 172.21.15.6:0/2518364199 >> v2:172.21.15.89:3300/0 conn(0x7fc6ec14b1f0 msgr2=0x7fc6ec0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.210+0000 7fc6eaffd640 1 --2- 172.21.15.6:0/2518364199 >> v2:172.21.15.89:3300/0 conn(0x7fc6ec14b1f0 0x7fc6ec0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.210+0000 7fc6eaffd640 1 -- 172.21.15.6:0/2518364199 >> v1:172.21.15.89:6789/0 conn(0x7fc6ec0ba550 legacy=0x7fc6ec14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.210+0000 7fc6eaffd640 1 -- 172.21.15.6:0/2518364199 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0c0120 con 0x7fc6ec06a6d0 2023-12-19T15:14:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.210+0000 7fc6eaffd640 1 --2- 172.21.15.6:0/2518364199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec14acb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0bde10 tx=0x7fc6dc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad4d9a20ce6222f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6e9ffb640 1 -- 172.21.15.6:0/2518364199 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc030860 con 0x7fc6ec06a6d0 2023-12-19T15:14:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6e9ffb640 1 -- 172.21.15.6:0/2518364199 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc0309c0 con 0x7fc6ec06a6d0 2023-12-19T15:14:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6e9ffb640 1 -- 172.21.15.6:0/2518364199 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc030d50 con 0x7fc6ec06a6d0 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 -- 172.21.15.6:0/2518364199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec06a6d0 msgr2=0x7fc6ec14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/2518364199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec14acb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0bde10 tx=0x7fc6dc02b9a0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 -- 172.21.15.6:0/2518364199 shutdown_connections 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/2518364199 >> v2:172.21.15.89:3300/0 conn(0x7fc6ec14b1f0 0x7fc6ec0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/2518364199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec14acb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 -- 172.21.15.6:0/2518364199 >> 172.21.15.6:0/2518364199 conn(0x7fc6ec0c0350 msgr2=0x7fc6ec0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 -- 172.21.15.6:0/2518364199 shutdown_connections 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.211+0000 7fc6f14ad640 1 -- 172.21.15.6:0/2518364199 wait complete. 2023-12-19T15:14:06.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.212+0000 7fc6f14ad640 1 Processor -- start 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 -- start start 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec0a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 0x7fc6ec146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6ec14b1f0 0x7fc6ec143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0a5c20 con 0x7fc6ec0ba550 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec145d40 con 0x7fc6ec06a6d0 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6f14ad640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec1465e0 con 0x7fc6ec14b1f0 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6ea7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 0x7fc6ec146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6ea7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 0x7fc6ec146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55390/0 (socket says 172.21.15.6:55390) 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6ea7fc640 1 -- 172.21.15.6:0/1504515284 learned_addr learned my addr 172.21.15.6:0/1504515284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6eaffd640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec0a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6eb7fe640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6ec14b1f0 0x7fc6ec143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.213+0000 7fc6ea7fc640 1 -- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6ec14b1f0 msgr2=0x7fc6ec143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6ea7fc640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6ec14b1f0 0x7fc6ec143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6ea7fc640 1 -- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6ec06a6d0 msgr2=0x7fc6ec0a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6ea7fc640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec0a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6ea7fc640 1 -- 172.21.15.6:0/1504515284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0094d0 con 0x7fc6ec0ba550 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6eb7fe640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6ec14b1f0 0x7fc6ec143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6ea7fc640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 0x7fc6ec146e70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d600 tx=0x7fc6e000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004240 con 0x7fc6ec0ba550 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e00043a0 con 0x7fc6ec0ba550 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec145f90 con 0x7fc6ec0ba550 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0003830 con 0x7fc6ec0ba550 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.214+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec14bda0 con 0x7fc6ec0ba550 2023-12-19T15:14:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.215+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec073a40 con 0x7fc6ec0ba550 2023-12-19T15:14:06.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.215+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6e0003990 con 0x7fc6ec0ba550 2023-12-19T15:14:06.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.216+0000 7fc6d37fe640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc6d806a430 0x7fc6d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.216+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6e0088a40 con 0x7fc6ec0ba550 2023-12-19T15:14:06.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.216+0000 7fc6eaffd640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc6d806a430 0x7fc6d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.216+0000 7fc6eaffd640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc6d806a430 0x7fc6d806c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc036000 tx=0x7fc6dc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.220+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6e008ae60 con 0x7fc6ec0ba550 2023-12-19T15:14:06.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.397+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6ec0a62d0 con 0x7fc6ec0ba550 2023-12-19T15:14:06.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.398+0000 7fc6d37fe640 1 -- 172.21.15.6:0/1504515284 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16005 (secure 0 0 0) 0x7fc6e0054030 con 0x7fc6ec0ba550 2023-12-19T15:14:06.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:06.399 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:49.344731+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc6d806a430 msgr2=0x7fc6d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc6d806a430 0x7fc6d806c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc036000 tx=0x7fc6dc008030 comp rx=0 tx=0).stop 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 msgr2=0x7fc6ec146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 0x7fc6ec146e70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d600 tx=0x7fc6e000dac0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 shutdown_connections 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fc6d806a430 0x7fc6d806c8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6ec14b1f0 0x7fc6ec143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0ba550 0x7fc6ec146e70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 --2- 172.21.15.6:0/1504515284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6ec06a6d0 0x7fc6ec0a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 >> 172.21.15.6:0/1504515284 conn(0x7fc6ec0c0350 msgr2=0x7fc6ec0a1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 shutdown_connections 2023-12-19T15:14:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.401+0000 7fc6f14ad640 1 -- 172.21.15.6:0/1504515284 wait complete. 2023-12-19T15:14:06.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T13:32:56.009075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T13:33:46.060812+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T13:33:47.322637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T15:14:06.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T15:14:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.525+0000 7f364d3b9640 1 Processor -- start 2023-12-19T15:14:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f364d3b9640 1 -- start start 2023-12-19T15:14:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f364d3b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f36480b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f364d3b9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480b5f00 con 0x7f364814be60 2023-12-19T15:14:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f364d3b9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480b61e0 con 0x7f36480bb1c0 2023-12-19T15:14:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f364d3b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480b8650 con 0x7f36480bc000 2023-12-19T15:14:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f36477fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f364814be60 0x7f36481426a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38582/0 (socket says 172.21.15.6:38582) 2023-12-19T15:14:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.526+0000 7f36477fe640 1 -- 172.21.15.6:0/2375248221 learned_addr learned my addr 172.21.15.6:0/2375248221 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:06.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f36467fc640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f36480b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895824010 0 0) 0x7f36480b5f00 con 0x7f364814be60 2023-12-19T15:14:06.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3630003520 con 0x7f364814be60 2023-12-19T15:14:06.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260336091 0 0) 0x7f36480b61e0 con 0x7f36480bb1c0 2023-12-19T15:14:06.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36480b5f00 con 0x7f36480bb1c0 2023-12-19T15:14:06.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3773611960 0 0) 0x7f3630003520 con 0x7f364814be60 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 msgr2=0x7f36480b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f36480b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 >> v1:172.21.15.89:6789/0 conn(0x7f36480bb1c0 legacy=0x7f36480b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480b7910 con 0x7f364814be60 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f36400019f0 con 0x7f364814be60 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 >> v1:172.21.15.6:6789/0 conn(0x7f364814be60 legacy=0x7f36481426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f3630003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3630004090 0x7f36300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3630004d00 0x7f3630005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480b8650 con 0x7f3630004d00 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363000ba60 con 0x7f3630004090 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363000bc20 con 0x7f36480bc000 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f3646ffd640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f3630003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f36477fe640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3630004d00 0x7f3630005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.527+0000 7f36467fc640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3630004090 0x7f36300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f36477fe640 1 -- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 msgr2=0x7f3630003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f36477fe640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f3630003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f36477fe640 1 -- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3630004090 msgr2=0x7f36300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f36477fe640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3630004090 0x7f36300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f36477fe640 1 -- 172.21.15.6:0/2375248221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630003520 con 0x7f3630004d00 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f3646ffd640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36480bc000 0x7f3630003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f36477fe640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3630004d00 0x7f3630005180 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f364000a7a0 tx=0x7f36300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1a9c26c79be770 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640034630 con 0x7f3630004d00 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364002f070 con 0x7f3630004d00 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.528+0000 7f3645ffb640 1 -- 172.21.15.6:0/2375248221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640034a10 con 0x7f3630004d00 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f364d3b9640 1 -- 172.21.15.6:0/2375248221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3630004d00 msgr2=0x7f3630005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f364d3b9640 1 --2- 172.21.15.6:0/2375248221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3630004d00 0x7f3630005180 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f364000a7a0 tx=0x7f36300057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f36477fe640 1 -- 172.21.15.6:0/2375248221 reap_dead start 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f364d3b9640 1 -- 172.21.15.6:0/2375248221 shutdown_connections 2023-12-19T15:14:06.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f364d3b9640 1 -- 172.21.15.6:0/2375248221 >> 172.21.15.6:0/2375248221 conn(0x7f3648069ee0 msgr2=0x7f364806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:06.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f364d3b9640 1 -- 172.21.15.6:0/2375248221 shutdown_connections 2023-12-19T15:14:06.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.529+0000 7f364d3b9640 1 -- 172.21.15.6:0/2375248221 wait complete. 2023-12-19T15:14:06.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.530+0000 7f364d3b9640 1 Processor -- start 2023-12-19T15:14:06.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.530+0000 7f364d3b9640 1 -- start start 2023-12-19T15:14:06.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f364d3b9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 0x7f36481dd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f364d3b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36481458b0 0x7f364813b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f364d3b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f364813b790 0x7f36480bd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f364d3b9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3648145d90 con 0x7f364813d9f0 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f364d3b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36481e0e40 con 0x7f364813b790 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f364d3b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36481e1120 con 0x7f36481458b0 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 0x7f36481dd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 0x7f36481dd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55408/0 (socket says 172.21.15.6:55408) 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 -- 172.21.15.6:0/3743944424 learned_addr learned my addr 172.21.15.6:0/3743944424 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f36477fe640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f364813b790 0x7f36480bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f36467fc640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36481458b0 0x7f364813b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 -- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36481458b0 msgr2=0x7f364813b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36481458b0 0x7f364813b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 -- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f364813b790 msgr2=0x7f36480bd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f364813b790 0x7f36480bd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f3646ffd640 1 -- 172.21.15.6:0/3743944424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36481e1400 con 0x7f364813d9f0 2023-12-19T15:14:06.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.531+0000 7f36467fc640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36481458b0 0x7f364813b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.532+0000 7f3646ffd640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 0x7f36481dd870 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f363c00fae0 tx=0x7f363c001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.532+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0052e0 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.532+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c005440 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.532+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00d990 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.532+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36481e16e0 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.532+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364813ddd0 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.533+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3648142d60 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.534+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f363c00daf0 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.534+0000 7f362f7fe640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f363406a460 0x7f363406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.534+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f363c088b30 con 0x7f364813d9f0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.534+0000 7f36467fc640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f363406a460 0x7f363406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.535+0000 7f36467fc640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f363406a460 0x7f363406c920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f364813d720 tx=0x7f3638008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.538+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f363c054090 con 0x7f364813d9f0 2023-12-19T15:14:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.714+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3648073a40 con 0x7f364813d9f0 2023-12-19T15:14:06.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.714+0000 7f362f7fe640 1 -- 172.21.15.6:0/3743944424 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f363c0576b0 con 0x7f364813d9f0 2023-12-19T15:14:06.715 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-12-19T15:14:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.716+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f363406a460 msgr2=0x7f363406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.716+0000 7f364d3b9640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f363406a460 0x7f363406c920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f364813d720 tx=0x7f3638008040 comp rx=0 tx=0).stop 2023-12-19T15:14:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 msgr2=0x7f36481dd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 0x7f36481dd870 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f363c00fae0 tx=0x7f363c001cf0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 shutdown_connections 2023-12-19T15:14:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f363406a460 0x7f363406c920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f364813b790 0x7f36480bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36481458b0 0x7f364813b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 --2- 172.21.15.6:0/3743944424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f364813d9f0 0x7f36481dd870 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 >> 172.21.15.6:0/3743944424 conn(0x7f3648069ee0 msgr2=0x7f36480b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 shutdown_connections 2023-12-19T15:14:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.717+0000 7f364d3b9640 1 -- 172.21.15.6:0/3743944424 wait complete. 2023-12-19T15:14:06.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T15:14:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.838+0000 7f403b3f0640 1 Processor -- start 2023-12-19T15:14:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.838+0000 7f403b3f0640 1 -- start start 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403b3f0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f403406a8d0 0x7f40341561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403b3f0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340ba5d0 con 0x7f40340b7410 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403b3f0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403406ad60 con 0x7f4034065c10 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403b3f0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40340bbf00 con 0x7f403406a8d0 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403998d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f403406a8d0 0x7f40341561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403998d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f403406a8d0 0x7f40341561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36008/0 (socket says 172.21.15.6:36008) 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403998d640 1 -- 172.21.15.6:0/3876195813 learned_addr learned my addr 172.21.15.6:0/3876195813 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403898b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40340b7410 0x7f4034152aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39138/0 (socket says 172.21.15.6:39138) 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403998d640 1 -- 172.21.15.6:0/3876195813 >> v1:172.21.15.89:6789/0 conn(0x7f4034065c10 legacy=0x7f40340ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.839+0000 7f403998d640 1 -- 172.21.15.6:0/3876195813 >> v1:172.21.15.6:6789/0 conn(0x7f40340b7410 legacy=0x7f4034152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.840+0000 7f403998d640 1 -- 172.21.15.6:0/3876195813 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4034072130 con 0x7f403406a8d0 2023-12-19T15:14:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.840+0000 7f403998d640 1 --2- 172.21.15.6:0/3876195813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f403406a8d0 0x7f40341561d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f402c009e50 tx=0x7f402c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786a121995ee0ba1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.840+0000 7f402bfff640 1 -- 172.21.15.6:0/3876195813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c02cb20 con 0x7f403406a8d0 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.840+0000 7f402bfff640 1 -- 172.21.15.6:0/3876195813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c02cc80 con 0x7f403406a8d0 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.840+0000 7f402bfff640 1 -- 172.21.15.6:0/3876195813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c0343f0 con 0x7f403406a8d0 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 -- 172.21.15.6:0/3876195813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f403406a8d0 msgr2=0x7f40341561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3876195813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f403406a8d0 0x7f40341561d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f402c009e50 tx=0x7f402c02bf80 comp rx=0 tx=0).stop 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 -- 172.21.15.6:0/3876195813 shutdown_connections 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3876195813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f403406a8d0 0x7f40341561d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 -- 172.21.15.6:0/3876195813 >> 172.21.15.6:0/3876195813 conn(0x7f40340b9250 msgr2=0x7f40340b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 -- 172.21.15.6:0/3876195813 shutdown_connections 2023-12-19T15:14:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.841+0000 7f403b3f0640 1 -- 172.21.15.6:0/3876195813 wait complete. 2023-12-19T15:14:06.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.842+0000 7f403b3f0640 1 Processor -- start 2023-12-19T15:14:06.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.842+0000 7f403b3f0640 1 -- start start 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403b3f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 0x7f40341d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403b3f0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403406a8d0 0x7f40341d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403b3f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40340b7410 0x7f40341d4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403b3f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341d4310 con 0x7f4034065c10 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403b3f0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341d1030 con 0x7f40340b7410 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403b3f0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40341d3d30 con 0x7f403406a8d0 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 0x7f40341d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 0x7f40341d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36020/0 (socket says 172.21.15.6:36020) 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 -- 172.21.15.6:0/3366009764 learned_addr learned my addr 172.21.15.6:0/3366009764 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403898b640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403406a8d0 0x7f40341d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403998d640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40340b7410 0x7f40341d4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 -- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403406a8d0 msgr2=0x7f40341d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403406a8d0 0x7f40341d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 -- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40340b7410 msgr2=0x7f40341d4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40340b7410 0x7f40341d4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 -- 172.21.15.6:0/3366009764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c009b30 con 0x7f4034065c10 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403998d640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40340b7410 0x7f40341d4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.843+0000 7f403918c640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 0x7f40341d0af0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f402400c450 tx=0x7f402400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.844+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240052d0 con 0x7f4034065c10 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.844+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024005430 con 0x7f4034065c10 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.844+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40341d56a0 con 0x7f4034065c10 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.844+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024012870 con 0x7f4034065c10 2023-12-19T15:14:06.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.844+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40341d35b0 con 0x7f4034065c10 2023-12-19T15:14:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.845+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40341d4580 con 0x7f4034065c10 2023-12-19T15:14:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.845+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40240129d0 con 0x7f4034065c10 2023-12-19T15:14:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.846+0000 7f4029ffb640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f401806a460 0x7f401806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.846+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4024088240 con 0x7f4034065c10 2023-12-19T15:14:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.846+0000 7f403898b640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f401806a460 0x7f401806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.846+0000 7f403898b640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f401806a460 0x7f401806c920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f40341d58f0 tx=0x7f4030007c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:06.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:06.850+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4024053830 con 0x7f4034065c10 2023-12-19T15:14:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.025+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40341d56a0 con 0x7f4034065c10 2023-12-19T15:14:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.026+0000 7f4029ffb640 1 -- 172.21.15.6:0/3366009764 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40341d56a0 con 0x7f4034065c10 2023-12-19T15:14:07.026 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f401806a460 msgr2=0x7f401806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f401806a460 0x7f401806c920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f40341d58f0 tx=0x7f4030007c80 comp rx=0 tx=0).stop 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 msgr2=0x7f40341d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 0x7f40341d0af0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f402400c450 tx=0x7f402400c910 comp rx=0 tx=0).stop 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 shutdown_connections 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f401806a460 0x7f401806c920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40340b7410 0x7f40341d4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403406a8d0 0x7f40341d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.027+0000 7f403b3f0640 1 --2- 172.21.15.6:0/3366009764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4034065c10 0x7f40341d0af0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.028+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 >> 172.21.15.6:0/3366009764 conn(0x7f40340b9250 msgr2=0x7f40340b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.028+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 shutdown_connections 2023-12-19T15:14:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.028+0000 7f403b3f0640 1 -- 172.21.15.6:0/3366009764 wait complete. 2023-12-19T15:14:07.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T15:14:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.147+0000 7fd6beffd640 1 Processor -- start 2023-12-19T15:14:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.147+0000 7fd6beffd640 1 -- start start 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6beffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6b8142f20 0x7fd6b80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6beffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6b80b94b0 0x7fd6b8153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6beffd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b81498f0 con 0x7fd6b80a0cc0 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6beffd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80b37e0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6beffd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b8148fc0 con 0x7fd6b8142f20 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6bd59a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6b80b94b0 0x7fd6b8153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6bd59a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6b80b94b0 0x7fd6b8153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36026/0 (socket says 172.21.15.6:36026) 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6bd59a640 1 -- 172.21.15.6:0/3726120631 learned_addr learned my addr 172.21.15.6:0/3726120631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.148+0000 7fd6bcd99640 1 --2- 172.21.15.6:0/3726120631 >> v2:172.21.15.89:3300/0 conn(0x7fd6b8142f20 0x7fd6b80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.149+0000 7fd6bd59a640 1 -- 172.21.15.6:0/3726120631 >> v2:172.21.15.89:3300/0 conn(0x7fd6b8142f20 msgr2=0x7fd6b80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.149+0000 7fd6bd59a640 1 --2- 172.21.15.6:0/3726120631 >> v2:172.21.15.89:3300/0 conn(0x7fd6b8142f20 0x7fd6b80b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.149+0000 7fd6bd59a640 1 -- 172.21.15.6:0/3726120631 >> v1:172.21.15.89:6789/0 conn(0x7fd6b80a0cc0 legacy=0x7fd6b80b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.149+0000 7fd6bd59a640 1 -- 172.21.15.6:0/3726120631 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b81492a0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.149+0000 7fd6bd59a640 1 --2- 172.21.15.6:0/3726120631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b8153280 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd6b806ac00 tx=0x7fd6b002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed890da7cbd864 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6b77fe640 1 -- 172.21.15.6:0/3726120631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b002cb20 con 0x7fd6b80b94b0 2023-12-19T15:14:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6b77fe640 1 -- 172.21.15.6:0/3726120631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b002cc80 con 0x7fd6b80b94b0 2023-12-19T15:14:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6b77fe640 1 -- 172.21.15.6:0/3726120631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00343f0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 -- 172.21.15.6:0/3726120631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 msgr2=0x7fd6b8153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3726120631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b8153280 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd6b806ac00 tx=0x7fd6b002bf80 comp rx=0 tx=0).stop 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 -- 172.21.15.6:0/3726120631 shutdown_connections 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3726120631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b8153280 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3726120631 >> v2:172.21.15.89:3300/0 conn(0x7fd6b8142f20 0x7fd6b80b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 -- 172.21.15.6:0/3726120631 >> 172.21.15.6:0/3726120631 conn(0x7fd6b80be1e0 msgr2=0x7fd6b80be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 -- 172.21.15.6:0/3726120631 shutdown_connections 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.150+0000 7fd6beffd640 1 -- 172.21.15.6:0/3726120631 wait complete. 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.151+0000 7fd6beffd640 1 Processor -- start 2023-12-19T15:14:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.151+0000 7fd6beffd640 1 -- start start 2023-12-19T15:14:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6b80a0cc0 0x7fd6b8136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b80bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6beffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6b8142f20 0x7fd6b806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6beffd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b806b750 con 0x7fd6b80b94b0 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6beffd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b81373a0 con 0x7fd6b80a0cc0 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6beffd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b806ce90 con 0x7fd6b8142f20 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b80bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b80bcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36038/0 (socket says 172.21.15.6:36038) 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6b7fff640 1 -- 172.21.15.6:0/3559453184 learned_addr learned my addr 172.21.15.6:0/3559453184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6bcd99640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6b80a0cc0 0x7fd6b8136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.152+0000 7fd6bd59a640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6b8142f20 0x7fd6b806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b7fff640 1 -- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6b8142f20 msgr2=0x7fd6b806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b7fff640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6b8142f20 0x7fd6b806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b7fff640 1 -- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6b80a0cc0 msgr2=0x7fd6b8136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b7fff640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6b80a0cc0 0x7fd6b8136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b7fff640 1 -- 172.21.15.6:0/3559453184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0009b30 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6bcd99640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6b80a0cc0 0x7fd6b8136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b7fff640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b80bcfd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400c430 tx=0x7fd6a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4011790 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a40118f0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b81e1100 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4011ca0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.153+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b81e0860 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.154+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8066e90 con 0x7fd6b80b94b0 2023-12-19T15:14:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.154+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6a401c460 con 0x7fd6b80b94b0 2023-12-19T15:14:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.155+0000 7fd6b57fa640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd69c06a430 0x7fd69c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.155+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a40887b0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.155+0000 7fd6bcd99640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd69c06a430 0x7fd69c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.156+0000 7fd6bcd99640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd69c06a430 0x7fd69c06c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006fd0 tx=0x7fd6ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.159+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6a4053da0 con 0x7fd6b80b94b0 2023-12-19T15:14:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.335+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6b806b890 con 0x7fd6b80b94b0 2023-12-19T15:14:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.335+0000 7fd6b57fa640 1 -- 172.21.15.6:0/3559453184 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6b806b890 con 0x7fd6b80b94b0 2023-12-19T15:14:07.336 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd69c06a430 msgr2=0x7fd69c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd69c06a430 0x7fd69c06c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006fd0 tx=0x7fd6ac008040 comp rx=0 tx=0).stop 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 msgr2=0x7fd6b80bcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b80bcfd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400c430 tx=0x7fd6a400c8f0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 shutdown_connections 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd69c06a430 0x7fd69c06c8f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6b8142f20 0x7fd6b806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b80b94b0 0x7fd6b80bcfd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 --2- 172.21.15.6:0/3559453184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6b80a0cc0 0x7fd6b8136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 >> 172.21.15.6:0/3559453184 conn(0x7fd6b80be1e0 msgr2=0x7fd6b806e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 shutdown_connections 2023-12-19T15:14:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.337+0000 7fd6beffd640 1 -- 172.21.15.6:0/3559453184 wait complete. 2023-12-19T15:14:07.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T15:14:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.454+0000 7fbf3dc51640 1 Processor -- start 2023-12-19T15:14:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf3dc51640 1 -- start start 2023-12-19T15:14:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf3dc51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38145110 0x7fbf38070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf3dc51640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3814bbe0 con 0x7fbf38069d00 2023-12-19T15:14:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf3dc51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3814b750 con 0x7fbf3806a140 2023-12-19T15:14:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf3dc51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380b7230 con 0x7fbf38145110 2023-12-19T15:14:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf36ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf38069d00 0x7fbf380b7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39144/0 (socket says 172.21.15.6:39144) 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.455+0000 7fbf36ffd640 1 -- 172.21.15.6:0/4232865012 learned_addr learned my addr 172.21.15.6:0/4232865012 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf377fe640 1 --2- 172.21.15.6:0/4232865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38145110 0x7fbf38070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf367fc640 1 -- 172.21.15.6:0/4232865012 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222973956 0 0) 0x7fbf3814bbe0 con 0x7fbf38069d00 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf367fc640 1 -- 172.21.15.6:0/4232865012 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf20003520 con 0x7fbf38069d00 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf377fe640 1 -- 172.21.15.6:0/4232865012 >> v1:172.21.15.89:6789/0 conn(0x7fbf3806a140 legacy=0x7fbf381554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf367fc640 1 -- 172.21.15.6:0/4232865012 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318838842 0 0) 0x7fbf20003520 con 0x7fbf38069d00 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf377fe640 1 -- 172.21.15.6:0/4232865012 >> v1:172.21.15.6:6789/0 conn(0x7fbf38069d00 legacy=0x7fbf380b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.456+0000 7fbf377fe640 1 -- 172.21.15.6:0/4232865012 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3814ae20 con 0x7fbf38145110 2023-12-19T15:14:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.457+0000 7fbf377fe640 1 --2- 172.21.15.6:0/4232865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38145110 0x7fbf38070350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0097d0 tx=0x7fbf2c02b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f646e95579ec928 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.457+0000 7fbf367fc640 1 -- 172.21.15.6:0/4232865012 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28001670 con 0x7fbf38145110 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.457+0000 7fbf367fc640 1 -- 172.21.15.6:0/4232865012 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c02e050 con 0x7fbf38145110 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.457+0000 7fbf367fc640 1 -- 172.21.15.6:0/4232865012 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c030730 con 0x7fbf38145110 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 -- 172.21.15.6:0/4232865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38145110 msgr2=0x7fbf38070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/4232865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38145110 0x7fbf38070350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0097d0 tx=0x7fbf2c02b770 comp rx=0 tx=0).stop 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 -- 172.21.15.6:0/4232865012 shutdown_connections 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/4232865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38145110 0x7fbf38070350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 -- 172.21.15.6:0/4232865012 >> 172.21.15.6:0/4232865012 conn(0x7fbf380bd060 msgr2=0x7fbf380bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 -- 172.21.15.6:0/4232865012 shutdown_connections 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.458+0000 7fbf3dc51640 1 -- 172.21.15.6:0/4232865012 wait complete. 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.459+0000 7fbf3dc51640 1 Processor -- start 2023-12-19T15:14:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.459+0000 7fbf3dc51640 1 -- start start 2023-12-19T15:14:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.459+0000 7fbf3dc51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38069d00 0x7fbf38146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.459+0000 7fbf3dc51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf3806a140 0x7fbf38149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf3dc51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 0x7fbf381e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf3dc51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf38147090 con 0x7fbf38145110 2023-12-19T15:14:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf3dc51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814a1f0 con 0x7fbf3806a140 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf3dc51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814a930 con 0x7fbf38069d00 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 0x7fbf381e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 0x7fbf381e3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36042/0 (socket says 172.21.15.6:36042) 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 -- 172.21.15.6:0/2433269315 learned_addr learned my addr 172.21.15.6:0/2433269315 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf377fe640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38069d00 0x7fbf38146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf36ffd640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf3806a140 0x7fbf38149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 -- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38069d00 msgr2=0x7fbf38146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38069d00 0x7fbf38146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 -- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf3806a140 msgr2=0x7fbf38149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf3806a140 0x7fbf38149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 -- 172.21.15.6:0/2433269315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c009400 con 0x7fbf38145110 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf37fff640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 0x7fbf381e3c40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c7a0 tx=0x7fbf3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30003b70 con 0x7fbf38145110 2023-12-19T15:14:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30003cf0 con 0x7fbf38145110 2023-12-19T15:14:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf38145b10 con 0x7fbf38145110 2023-12-19T15:14:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30003ea0 con 0x7fbf38145110 2023-12-19T15:14:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.460+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf381460d0 con 0x7fbf38145110 2023-12-19T15:14:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.461+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf381e3960 con 0x7fbf38145110 2023-12-19T15:14:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.462+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf3000aa90 con 0x7fbf38145110 2023-12-19T15:14:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.462+0000 7fbf1ffff640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbf2406a430 0x7fbf2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.462+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf30088690 con 0x7fbf38145110 2023-12-19T15:14:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.463+0000 7fbf377fe640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbf2406a430 0x7fbf2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.463+0000 7fbf377fe640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbf2406a430 0x7fbf2406c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c034000 tx=0x7fbf2c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.466+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf381e3960 con 0x7fbf38145110 2023-12-19T15:14:07.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.682+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf381e3960 con 0x7fbf38145110 2023-12-19T15:14:07.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.682+0000 7fbf1ffff640 1 -- 172.21.15.6:0/2433269315 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3882 (secure 0 0 0) 0x7fbf381e3960 con 0x7fbf38145110 2023-12-19T15:14:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:07.682 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:48.343293+0000","modified":"2023-12-19T13:33:50.971099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/331533137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":331533137},{"type":"v1","addr":"172.21.15.6:6835","nonce":331533137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T15:14:07.683 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2023-12-19T15:14:07.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbf2406a430 msgr2=0x7fbf2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbf2406a430 0x7fbf2406c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c034000 tx=0x7fbf2c008030 comp rx=0 tx=0).stop 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 msgr2=0x7fbf381e3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 0x7fbf381e3c40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c7a0 tx=0x7fbf3000cc60 comp rx=0 tx=0).stop 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 shutdown_connections 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbf2406a430 0x7fbf2406c8f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf38145110 0x7fbf381e3c40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf3806a140 0x7fbf38149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 --2- 172.21.15.6:0/2433269315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf38069d00 0x7fbf38146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 >> 172.21.15.6:0/2433269315 conn(0x7fbf380bd060 msgr2=0x7fbf380b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 shutdown_connections 2023-12-19T15:14:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.684+0000 7fbf3dc51640 1 -- 172.21.15.6:0/2433269315 wait complete. 2023-12-19T15:14:07.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T15:14:07.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.801+0000 7f82e4d6e640 1 Processor -- start 2023-12-19T15:14:07.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.801+0000 7f82e4d6e640 1 -- start start 2023-12-19T15:14:07.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.801+0000 7f82e4d6e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82e00b7ea0 0x7f82e00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82e4d6e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00b4230 con 0x7f82e00b8280 2023-12-19T15:14:07.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82e4d6e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00711c0 con 0x7f82e00b7130 2023-12-19T15:14:07.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82e4d6e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00714a0 con 0x7f82e00b7ea0 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ded9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f82e00b8280 0x7f82e00b89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39152/0 (socket says 172.21.15.6:39152) 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ded9d640 1 -- 172.21.15.6:0/4047362019 learned_addr learned my addr 172.21.15.6:0/4047362019 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82de59c640 1 --2- 172.21.15.6:0/4047362019 >> v2:172.21.15.89:3300/0 conn(0x7f82e00b7ea0 0x7f82e00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107856956 0 0) 0x7f82e00b4230 con 0x7f82e00b8280 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82cc003520 con 0x7f82e00b8280 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265249972 0 0) 0x7f82cc003520 con 0x7f82e00b8280 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 >> v2:172.21.15.89:3300/0 conn(0x7f82e00b7ea0 msgr2=0x7f82e00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 --2- 172.21.15.6:0/4047362019 >> v2:172.21.15.89:3300/0 conn(0x7f82e00b7ea0 0x7f82e00b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 >> v1:172.21.15.89:6789/0 conn(0x7f82e00b7130 legacy=0x7f82e0142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0071780 con 0x7f82e00b8280 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f82d80019f0 con 0x7f82e00b8280 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 >> v1:172.21.15.6:6789/0 conn(0x7f82e00b8280 legacy=0x7f82e00b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc003970 0x7f82cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82cc0047c0 0x7f82cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc005180 0x7f82cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00714a0 con 0x7f82cc005180 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc00c030 con 0x7f82cc0047c0 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc00c1f0 con 0x7f82cc003970 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82ded9d640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc005180 0x7f82cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82de59c640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc003970 0x7f82cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.802+0000 7f82d7fff640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82cc0047c0 0x7f82cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 -- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc003970 msgr2=0x7f82cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc003970 0x7f82cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 -- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82cc0047c0 msgr2=0x7f82cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82cc0047c0 0x7f82cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 -- 172.21.15.6:0/4047362019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc003520 con 0x7f82cc005180 2023-12-19T15:14:07.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 -- 172.21.15.6:0/4047362019 reap_dead start 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.803+0000 7f82ded9d640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc005180 0x7f82cc00b980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f82d800a820 tx=0x7f82cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1eb84a1f2f60085 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80072d0 con 0x7f82cc005180 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d802f070 con 0x7f82cc005180 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82ddd9b640 1 -- 172.21.15.6:0/4047362019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80076b0 con 0x7f82cc005180 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 -- 172.21.15.6:0/4047362019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc005180 msgr2=0x7f82cc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc005180 0x7f82cc00b980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f82d800a820 tx=0x7f82cc0057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 -- 172.21.15.6:0/4047362019 shutdown_connections 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/4047362019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82cc005180 0x7f82cc00b980 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 -- 172.21.15.6:0/4047362019 >> 172.21.15.6:0/4047362019 conn(0x7f82e00bd060 msgr2=0x7f82e00bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 -- 172.21.15.6:0/4047362019 shutdown_connections 2023-12-19T15:14:07.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.804+0000 7f82e4d6e640 1 -- 172.21.15.6:0/4047362019 wait complete. 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.806+0000 7f82e4d6e640 1 Processor -- start 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.806+0000 7f82e4d6e640 1 -- start start 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82e4d6e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc005180 0x7f82e0145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82e4d6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82e01cf1e0 0x7f82e01e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82e4d6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 0x7f82e013ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82e4d6e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0146520 con 0x7f82e01e2450 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82e4d6e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01e17a0 con 0x7f82e01cf1e0 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82e4d6e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01de2a0 con 0x7f82cc005180 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 0x7f82e013ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 0x7f82e013ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36062/0 (socket says 172.21.15.6:36062) 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 -- 172.21.15.6:0/824663584 learned_addr learned my addr 172.21.15.6:0/824663584 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82de59c640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc005180 0x7f82e0145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82d7fff640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82e01cf1e0 0x7f82e01e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 -- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc005180 msgr2=0x7f82e0145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc005180 0x7f82e0145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 -- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82e01cf1e0 msgr2=0x7f82e01e1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82e01cf1e0 0x7f82e01e1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82ded9d640 1 -- 172.21.15.6:0/824663584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0141380 con 0x7f82e01e2450 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.807+0000 7f82de59c640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc005180 0x7f82e0145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.808+0000 7f82ded9d640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 0x7f82e013ae00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f82d8000f80 tx=0x7f82e0070480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.808+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80019f0 con 0x7f82e01e2450 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.808+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8004b60 con 0x7f82e01e2450 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.808+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e0141660 con 0x7f82e01e2450 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.808+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8007400 con 0x7f82e01e2450 2023-12-19T15:14:07.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.808+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e01cf640 con 0x7f82e01e2450 2023-12-19T15:14:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.809+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e01e1c30 con 0x7f82e01e2450 2023-12-19T15:14:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.809+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f82d8031030 con 0x7f82e01e2450 2023-12-19T15:14:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.810+0000 7f82d6ffd640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f82c006a460 0x7f82c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.810+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82d80aa580 con 0x7f82e01e2450 2023-12-19T15:14:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.810+0000 7f82de59c640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f82c006a460 0x7f82c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.811+0000 7f82de59c640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f82c006a460 0x7f82c006c920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009b40 tx=0x7f82d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.814+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f82e01e1c30 con 0x7f82e01e2450 2023-12-19T15:14:07.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.994+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82e01e1c30 con 0x7f82e01e2450 2023-12-19T15:14:07.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.995+0000 7f82d6ffd640 1 -- 172.21.15.6:0/824663584 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16005 (secure 0 0 0) 0x7f82e01e1c30 con 0x7f82e01e2450 2023-12-19T15:14:07.995 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:07.995 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:49.344731+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T15:14:07.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f82c006a460 msgr2=0x7f82c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f82c006a460 0x7f82c006c920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009b40 tx=0x7f82d0008040 comp rx=0 tx=0).stop 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 msgr2=0x7f82e013ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 0x7f82e013ae00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f82d8000f80 tx=0x7f82e0070480 comp rx=0 tx=0).stop 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 shutdown_connections 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f82c006a460 0x7f82c006c920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e01e2450 0x7f82e013ae00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82e01cf1e0 0x7f82e01e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 --2- 172.21.15.6:0/824663584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82cc005180 0x7f82e0145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 >> 172.21.15.6:0/824663584 conn(0x7f82e00bd060 msgr2=0x7f82e00bc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 shutdown_connections 2023-12-19T15:14:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:07.997+0000 7f82e4d6e640 1 -- 172.21.15.6:0/824663584 wait complete. 2023-12-19T15:14:08.008 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T15:14:08.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T15:14:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.114+0000 7f1b3e0ce640 1 Processor -- start 2023-12-19T15:14:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.114+0000 7f1b3e0ce640 1 -- start start 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b3e0ce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 0x7f1b3806f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b3e0ce640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b3806d7b0 0x7f1b380b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b3e0ce640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380ba780 con 0x7f1b380ba3a0 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b3e0ce640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380b5330 con 0x7f1b3806d7b0 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b3e0ce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3806f900 con 0x7f1b3814ca90 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b36ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 0x7f1b3806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b37fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b3806d7b0 0x7f1b380b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b36ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 0x7f1b3806f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:53846/0 (socket says 172.21.15.6:53846) 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b377fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1b380ba3a0 0x7f1b380b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:56650/0 (socket says 172.21.15.6:56650) 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b37fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b3806d7b0 0x7f1b380b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:60770/0 (socket says 172.21.15.6:60770) 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.115+0000 7f1b36ffd640 1 -- 172.21.15.6:0/3612417409 learned_addr learned my addr 172.21.15.6:0/3612417409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b367fc640 1 -- 172.21.15.6:0/3612417409 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740801676 0 0) 0x7f1b380ba780 con 0x7f1b380ba3a0 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b367fc640 1 -- 172.21.15.6:0/3612417409 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24003520 con 0x7f1b380ba3a0 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b37fff640 1 -- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 msgr2=0x7f1b3806f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b37fff640 1 --2- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 0x7f1b3806f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b37fff640 1 -- 172.21.15.6:0/3612417409 >> v1:172.21.15.89:6789/0 conn(0x7f1b380ba3a0 legacy=0x7f1b380b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b37fff640 1 -- 172.21.15.6:0/3612417409 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3814c600 con 0x7f1b3806d7b0 2023-12-19T15:14:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b36ffd640 1 --2- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 0x7f1b3806f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.116+0000 7f1b37fff640 1 --2- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806d7b0 0x7f1b380b4df0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009d90 tx=0x7f1b3002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83996f5a8e57d231 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b367fc640 1 -- 172.21.15.6:0/3612417409 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3002cc50 con 0x7f1b3806d7b0 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b367fc640 1 -- 172.21.15.6:0/3612417409 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3002cdb0 con 0x7f1b3806d7b0 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b367fc640 1 -- 172.21.15.6:0/3612417409 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30034660 con 0x7f1b3806d7b0 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806d7b0 msgr2=0x7f1b380b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806d7b0 0x7f1b380b4df0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009d90 tx=0x7f1b3002bea0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/3612417409 shutdown_connections 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3806d7b0 0x7f1b380b4df0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/3612417409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b3814ca90 0x7f1b3806f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/3612417409 >> 172.21.15.6:0/3612417409 conn(0x7f1b380bac30 msgr2=0x7f1b380bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/3612417409 shutdown_connections 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.117+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/3612417409 wait complete. 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.118+0000 7f1b3e0ce640 1 Processor -- start 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 -- start start 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 0x7f1b380a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b380ba3a0 0x7f1b380b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3814ca90 0x7f1b380b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380a2820 con 0x7f1b3806d7b0 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3806c730 con 0x7f1b3814ca90 2023-12-19T15:14:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b3e0ce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3806b7b0 con 0x7f1b380ba3a0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b377fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 0x7f1b380a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b377fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 0x7f1b380a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36074/0 (socket says 172.21.15.6:36074) 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b377fe640 1 -- 172.21.15.6:0/4168598342 learned_addr learned my addr 172.21.15.6:0/4168598342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b37fff640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3814ca90 0x7f1b380b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.119+0000 7f1b36ffd640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b380ba3a0 0x7f1b380b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b377fe640 1 -- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b380ba3a0 msgr2=0x7f1b380b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b377fe640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b380ba3a0 0x7f1b380b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b377fe640 1 -- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3814ca90 msgr2=0x7f1b380b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b377fe640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3814ca90 0x7f1b380b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b377fe640 1 -- 172.21.15.6:0/4168598342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200094d0 con 0x7f1b3806d7b0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b37fff640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3814ca90 0x7f1b380b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b377fe640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 0x7f1b380a22e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c500 tx=0x7f1b2800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28007500 con 0x7f1b3806d7b0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28007660 con 0x7f1b3806d7b0 2023-12-19T15:14:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b30009a70 con 0x7f1b3806d7b0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28004a20 con 0x7f1b3806d7b0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.120+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3806bd70 con 0x7f1b3806d7b0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.121+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b38073a40 con 0x7f1b3806d7b0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.121+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b28004b80 con 0x7f1b3806d7b0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.122+0000 7f1b2ffff640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b1806a460 0x7f1b1806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.122+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b28087c20 con 0x7f1b3806d7b0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.122+0000 7f1b36ffd640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b1806a460 0x7f1b1806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.123+0000 7f1b36ffd640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b1806a460 0x7f1b1806c920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b381e0c80 tx=0x7f1b20008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.126+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1b280532e0 con 0x7f1b3806d7b0 2023-12-19T15:14:08.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.337+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b3806ec50 con 0x7f1b3806d7b0 2023-12-19T15:14:08.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.338+0000 7f1b2ffff640 1 -- 172.21.15.6:0/4168598342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3882 (secure 0 0 0) 0x7f1b28056900 con 0x7f1b3806d7b0 2023-12-19T15:14:08.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:08.338 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:48.343293+0000","modified":"2023-12-19T13:33:50.971099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/331533137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":331533137},{"type":"v1","addr":"172.21.15.6:6835","nonce":331533137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T15:14:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b1806a460 msgr2=0x7f1b1806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b1806a460 0x7f1b1806c920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b381e0c80 tx=0x7f1b20008040 comp rx=0 tx=0).stop 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 msgr2=0x7f1b380a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 0x7f1b380a22e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c500 tx=0x7f1b2800c9c0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 shutdown_connections 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f1b1806a460 0x7f1b1806c920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b3814ca90 0x7f1b380b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b380ba3a0 0x7f1b380b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 --2- 172.21.15.6:0/4168598342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3806d7b0 0x7f1b380a22e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 >> 172.21.15.6:0/4168598342 conn(0x7f1b380bac30 msgr2=0x7f1b380b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 shutdown_connections 2023-12-19T15:14:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.340+0000 7f1b3e0ce640 1 -- 172.21.15.6:0/4168598342 wait complete. 2023-12-19T15:14:08.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T15:14:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.456+0000 7f2f6bc5f640 1 Processor -- start 2023-12-19T15:14:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.456+0000 7f2f6bc5f640 1 -- start start 2023-12-19T15:14:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f6bc5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f64148140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f6bc5f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6409fab0 con 0x7f2f6414b620 2023-12-19T15:14:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f6bc5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640bae90 con 0x7f2f64148680 2023-12-19T15:14:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f6bc5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640bb170 con 0x7f2f640bfad0 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f6a1fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f6414b620 0x7f2f64155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39166/0 (socket says 172.21.15.6:39166) 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f6a1fc640 1 -- 172.21.15.6:0/1948425260 learned_addr learned my addr 172.21.15.6:0/1948425260 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f699fb640 1 --2- 172.21.15.6:0/1948425260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f64148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289225073 0 0) 0x7f2f6409fab0 con 0x7f2f6414b620 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f50003520 con 0x7f2f6414b620 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701377293 0 0) 0x7f2f640bae90 con 0x7f2f64148680 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.457+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6409fab0 con 0x7f2f64148680 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.458+0000 7f2f699fb640 1 -- 172.21.15.6:0/1948425260 >> v1:172.21.15.89:6789/0 conn(0x7f2f64148680 legacy=0x7f2f6414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.458+0000 7f2f699fb640 1 -- 172.21.15.6:0/1948425260 >> v1:172.21.15.6:6789/0 conn(0x7f2f6414b620 legacy=0x7f2f64155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.458+0000 7f2f699fb640 1 -- 172.21.15.6:0/1948425260 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640bb450 con 0x7f2f640bfad0 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.458+0000 7f2f699fb640 1 --2- 172.21.15.6:0/1948425260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f64148140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097d0 tx=0x7f2f5402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ff7ae8cfbeafe33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.458+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54031800 con 0x7f2f640bfad0 2023-12-19T15:14:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54031960 con 0x7f2f640bfad0 2023-12-19T15:14:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f689f9640 1 -- 172.21.15.6:0/1948425260 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54031cf0 con 0x7f2f640bfad0 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/1948425260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 msgr2=0x7f2f64148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/1948425260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f64148140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097d0 tx=0x7f2f5402b8a0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/1948425260 shutdown_connections 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/1948425260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f64148140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/1948425260 >> 172.21.15.6:0/1948425260 conn(0x7f2f640c0370 msgr2=0x7f2f640c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/1948425260 shutdown_connections 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.459+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/1948425260 wait complete. 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.460+0000 7f2f6bc5f640 1 Processor -- start 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.460+0000 7f2f6bc5f640 1 -- start start 2023-12-19T15:14:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6bc5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f6414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6bc5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 0x7f2f6414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6bc5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6414b620 0x7f2f6414e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6bc5f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6414ec70 con 0x7f2f64148680 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6bc5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6414ca10 con 0x7f2f6414b620 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6bc5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6414ccb0 con 0x7f2f640bfad0 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 0x7f2f6414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 0x7f2f6414d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36084/0 (socket says 172.21.15.6:36084) 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 -- 172.21.15.6:0/2337375793 learned_addr learned my addr 172.21.15.6:0/2337375793 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f699fb640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f6414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f6a1fc640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6414b620 0x7f2f6414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 -- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 msgr2=0x7f2f6414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f6414d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 -- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6414b620 msgr2=0x7f2f6414e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6414b620 0x7f2f6414e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 -- 172.21.15.6:0/2337375793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009400 con 0x7f2f64148680 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.461+0000 7f2f691fa640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 0x7f2f6414d140 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000c490 tx=0x7f2f6000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.462+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f600052d0 con 0x7f2f64148680 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.462+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60005430 con 0x7f2f64148680 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.462+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60012870 con 0x7f2f64148680 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.462+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f640b4890 con 0x7f2f64148680 2023-12-19T15:14:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.462+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6414e110 con 0x7f2f64148680 2023-12-19T15:14:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.463+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6414ce20 con 0x7f2f64148680 2023-12-19T15:14:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.463+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f600129d0 con 0x7f2f64148680 2023-12-19T15:14:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.464+0000 7f2f5a7fc640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f2f4806a430 0x7f2f4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.464+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f600883c0 con 0x7f2f64148680 2023-12-19T15:14:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.464+0000 7f2f699fb640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f2f4806a430 0x7f2f4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.464+0000 7f2f699fb640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f2f4806a430 0x7f2f4806c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2f54036000 tx=0x7f2f5403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.468+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f600539e0 con 0x7f2f64148680 2023-12-19T15:14:08.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.680+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f64073a40 con 0x7f2f64148680 2023-12-19T15:14:08.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.681+0000 7f2f5a7fc640 1 -- 172.21.15.6:0/2337375793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3882 (secure 0 0 0) 0x7f2f60057000 con 0x7f2f64148680 2023-12-19T15:14:08.681 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:08.681 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T13:33:48.343293+0000","modified":"2023-12-19T13:33:50.971099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/331533137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":331533137},{"type":"v1","addr":"172.21.15.6:6835","nonce":331533137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T15:14:08.682 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2023-12-19T15:14:08.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f2f4806a430 msgr2=0x7f2f4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f2f4806a430 0x7f2f4806c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2f54036000 tx=0x7f2f5403c040 comp rx=0 tx=0).stop 2023-12-19T15:14:08.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 msgr2=0x7f2f6414d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 0x7f2f6414d140 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000c490 tx=0x7f2f6000c950 comp rx=0 tx=0).stop 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 shutdown_connections 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f2f4806a430 0x7f2f4806c8f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6414b620 0x7f2f6414e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f64148680 0x7f2f6414d140 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 --2- 172.21.15.6:0/2337375793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f640bfad0 0x7f2f6414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 >> 172.21.15.6:0/2337375793 conn(0x7f2f640c0370 msgr2=0x7f2f640a0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 shutdown_connections 2023-12-19T15:14:08.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.683+0000 7f2f6bc5f640 1 -- 172.21.15.6:0/2337375793 wait complete. 2023-12-19T15:14:08.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T15:14:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.800+0000 7fe332f8e640 1 Processor -- start 2023-12-19T15:14:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.800+0000 7fe332f8e640 1 -- start start 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe332f8e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe32c14ca90 0x7fe32c06f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe332f8e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe32c06d7b0 0x7fe32c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe332f8e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0ba780 con 0x7fe32c0ba3a0 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe332f8e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0b5330 con 0x7fe32c06d7b0 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe332f8e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c06f900 con 0x7fe32c14ca90 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe32c06d7b0 0x7fe32c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe32c06d7b0 0x7fe32c0b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36094/0 (socket says 172.21.15.6:36094) 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 -- 172.21.15.6:0/1070550541 learned_addr learned my addr 172.21.15.6:0/1070550541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe32bfff640 1 --2- 172.21.15.6:0/1070550541 >> v2:172.21.15.89:3300/0 conn(0x7fe32c14ca90 0x7fe32c06f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 -- 172.21.15.6:0/1070550541 >> v2:172.21.15.89:3300/0 conn(0x7fe32c14ca90 msgr2=0x7fe32c06f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 --2- 172.21.15.6:0/1070550541 >> v2:172.21.15.89:3300/0 conn(0x7fe32c14ca90 0x7fe32c06f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 -- 172.21.15.6:0/1070550541 >> v1:172.21.15.89:6789/0 conn(0x7fe32c0ba3a0 legacy=0x7fe32c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe33152b640 1 -- 172.21.15.6:0/1070550541 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c14c600 con 0x7fe32c06d7b0 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.801+0000 7fe32bfff640 1 --2- 172.21.15.6:0/1070550541 >> v2:172.21.15.89:3300/0 conn(0x7fe32c14ca90 0x7fe32c06f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.802+0000 7fe33152b640 1 --2- 172.21.15.6:0/1070550541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b4df0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0a3840 tx=0x7fe32402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0512224fbf09656 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.802+0000 7fe32b7fe640 1 -- 172.21.15.6:0/1070550541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32402cb20 con 0x7fe32c06d7b0 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.802+0000 7fe32b7fe640 1 -- 172.21.15.6:0/1070550541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32402cc80 con 0x7fe32c06d7b0 2023-12-19T15:14:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.802+0000 7fe32b7fe640 1 -- 172.21.15.6:0/1070550541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240343f0 con 0x7fe32c06d7b0 2023-12-19T15:14:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.802+0000 7fe332f8e640 1 -- 172.21.15.6:0/1070550541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c06d7b0 msgr2=0x7fe32c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.802+0000 7fe332f8e640 1 --2- 172.21.15.6:0/1070550541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b4df0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0a3840 tx=0x7fe32402bf80 comp rx=0 tx=0).stop 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.803+0000 7fe332f8e640 1 -- 172.21.15.6:0/1070550541 shutdown_connections 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.803+0000 7fe332f8e640 1 --2- 172.21.15.6:0/1070550541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b4df0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.803+0000 7fe332f8e640 1 --2- 172.21.15.6:0/1070550541 >> v2:172.21.15.89:3300/0 conn(0x7fe32c14ca90 0x7fe32c06f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.803+0000 7fe332f8e640 1 -- 172.21.15.6:0/1070550541 >> 172.21.15.6:0/1070550541 conn(0x7fe32c0bac30 msgr2=0x7fe32c0bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.803+0000 7fe332f8e640 1 -- 172.21.15.6:0/1070550541 shutdown_connections 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.803+0000 7fe332f8e640 1 -- 172.21.15.6:0/1070550541 wait complete. 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 Processor -- start 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 -- start start 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c0ba3a0 0x7fe32c141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 0x7fe32c1e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1423c0 con 0x7fe32c14ca90 2023-12-19T15:14:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1e3bf0 con 0x7fe32c06d7b0 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe332f8e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c06ca10 con 0x7fe32c0ba3a0 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.804+0000 7fe33152b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 0x7fe32c1e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 0x7fe32c1e4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36102/0 (socket says 172.21.15.6:36102) 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 -- 172.21.15.6:0/2818999892 learned_addr learned my addr 172.21.15.6:0/2818999892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe330d2a640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe32bfff640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c0ba3a0 0x7fe32c141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 -- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c0ba3a0 msgr2=0x7fe32c141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c0ba3a0 0x7fe32c141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 -- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c06d7b0 msgr2=0x7fe32c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 -- 172.21.15.6:0/2818999892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009b30 con 0x7fe32c14ca90 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe33152b640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 0x7fe32c1e4080 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe324036040 tx=0x7fe324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324007e70 con 0x7fe32c14ca90 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324009510 con 0x7fe32c14ca90 2023-12-19T15:14:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c06ccf0 con 0x7fe32c14ca90 2023-12-19T15:14:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32403e690 con 0x7fe32c14ca90 2023-12-19T15:14:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.805+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c06af30 con 0x7fe32c14ca90 2023-12-19T15:14:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.806+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c1e3d80 con 0x7fe32c14ca90 2023-12-19T15:14:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.807+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe32403e7f0 con 0x7fe32c14ca90 2023-12-19T15:14:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.807+0000 7fe3297fa640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe31006a430 0x7fe31006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.807+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3240ab600 con 0x7fe32c14ca90 2023-12-19T15:14:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.807+0000 7fe330d2a640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe31006a430 0x7fe31006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.808+0000 7fe330d2a640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe31006a430 0x7fe31006c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe320000f60 tx=0x7fe320009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.811+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe324076db0 con 0x7fe32c14ca90 2023-12-19T15:14:08.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.988+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32c073a40 con 0x7fe32c14ca90 2023-12-19T15:14:08.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.989+0000 7fe3297fa640 1 -- 172.21.15.6:0/2818999892 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16005 (secure 0 0 0) 0x7fe32407a3d0 con 0x7fe32c14ca90 2023-12-19T15:14:08.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:08.989 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T13:33:49.344731+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T13:33:46.060812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T13:33:47.322637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T15:14:08.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe31006a430 msgr2=0x7fe31006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe31006a430 0x7fe31006c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe320000f60 tx=0x7fe320009040 comp rx=0 tx=0).stop 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 msgr2=0x7fe32c1e4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 0x7fe32c1e4080 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe324036040 tx=0x7fe324004a40 comp rx=0 tx=0).stop 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 shutdown_connections 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe31006a430 0x7fe31006c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe32c14ca90 0x7fe32c1e4080 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c0ba3a0 0x7fe32c141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 --2- 172.21.15.6:0/2818999892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c06d7b0 0x7fe32c0b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 >> 172.21.15.6:0/2818999892 conn(0x7fe32c0bac30 msgr2=0x7fe32c0bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 shutdown_connections 2023-12-19T15:14:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:08.991+0000 7fe332f8e640 1 -- 172.21.15.6:0/2818999892 wait complete. 2023-12-19T15:14:09.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T15:14:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.109+0000 7f12c645f640 1 Processor -- start 2023-12-19T15:14:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.109+0000 7f12c645f640 1 -- start start 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.109+0000 7f12c645f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c0140f40 0x7f12c01413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c645f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c01418f0 con 0x7f12c00bacf0 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c645f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c014af40 con 0x7f12c00b8340 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c645f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00b7ee0 con 0x7f12c0140f40 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12bf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f12c00bacf0 0x7f12c00ba230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39182/0 (socket says 172.21.15.6:39182) 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12bf7fe640 1 -- 172.21.15.6:0/1651021962 learned_addr learned my addr 172.21.15.6:0/1651021962 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c49fc640 1 --2- 172.21.15.6:0/1651021962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c0140f40 0x7f12c01413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724529247 0 0) 0x7f12b4001110 con 0x7f12c00bacf0 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a8003520 con 0x7f12c00bacf0 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258507916 0 0) 0x7f12c014af40 con 0x7f12c00b8340 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b4001110 con 0x7f12c00b8340 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c49fc640 1 -- 172.21.15.6:0/1651021962 >> v1:172.21.15.89:6789/0 conn(0x7f12c00b8340 legacy=0x7f12c014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c49fc640 1 -- 172.21.15.6:0/1651021962 >> v1:172.21.15.6:6789/0 conn(0x7f12c00bacf0 legacy=0x7f12c00ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.110+0000 7f12c49fc640 1 -- 172.21.15.6:0/1651021962 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c01450a0 con 0x7f12c0140f40 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.111+0000 7f12c49fc640 1 --2- 172.21.15.6:0/1651021962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c0140f40 0x7f12c01413b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009dc0 tx=0x7f12b802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51f82825ae6f624 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.111+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b802cd50 con 0x7f12c0140f40 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.111+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8034440 con 0x7f12c0140f40 2023-12-19T15:14:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.111+0000 7f12beffd640 1 -- 172.21.15.6:0/1651021962 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b80347d0 con 0x7f12c0140f40 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 -- 172.21.15.6:0/1651021962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c0140f40 msgr2=0x7f12c01413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 --2- 172.21.15.6:0/1651021962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c0140f40 0x7f12c01413b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009dc0 tx=0x7f12b802bfa0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 -- 172.21.15.6:0/1651021962 shutdown_connections 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 --2- 172.21.15.6:0/1651021962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c0140f40 0x7f12c01413b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 -- 172.21.15.6:0/1651021962 >> 172.21.15.6:0/1651021962 conn(0x7f12c00c0370 msgr2=0x7f12c00c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 -- 172.21.15.6:0/1651021962 shutdown_connections 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.112+0000 7f12c645f640 1 -- 172.21.15.6:0/1651021962 wait complete. 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.113+0000 7f12c645f640 1 Processor -- start 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.113+0000 7f12c645f640 1 -- start start 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c645f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c00b8340 0x7f12c01390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c645f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 0x7f12c014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c645f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12c0140f40 0x7f12c01dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c645f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01395f0 con 0x7f12c00bacf0 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c645f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c014de90 con 0x7f12c0140f40 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c645f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01e30a0 con 0x7f12c00b8340 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 0x7f12c014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c00b8340 0x7f12c01390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 0x7f12c014e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36118/0 (socket says 172.21.15.6:36118) 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 -- 172.21.15.6:0/2130373971 learned_addr learned my addr 172.21.15.6:0/2130373971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12c49fc640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12c0140f40 0x7f12c01dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 -- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c00b8340 msgr2=0x7f12c01390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c00b8340 0x7f12c01390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 -- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12c0140f40 msgr2=0x7f12c01dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12c0140f40 0x7f12c01dfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 -- 172.21.15.6:0/2130373971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009a70 con 0x7f12c00bacf0 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bffff640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c00b8340 0x7f12c01390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bf7fe640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 0x7f12c014e820 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f12b400c760 tx=0x7f12b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4005ce0 con 0x7f12c00bacf0 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.114+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4005e60 con 0x7f12c00bacf0 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.115+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c01e3340 con 0x7f12c00bacf0 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.115+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40072b0 con 0x7f12c00bacf0 2023-12-19T15:14:09.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.115+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c01e3900 con 0x7f12c00bacf0 2023-12-19T15:14:09.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.116+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c00b9620 con 0x7f12c00bacf0 2023-12-19T15:14:09.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.116+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12b4007410 con 0x7f12c00bacf0 2023-12-19T15:14:09.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.116+0000 7f12bcff9640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f12ac06a460 0x7f12ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.117+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12b4087e10 con 0x7f12c00bacf0 2023-12-19T15:14:09.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.117+0000 7f12bffff640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f12ac06a460 0x7f12ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.117+0000 7f12bffff640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f12ac06a460 0x7f12ac06c920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12b0007fd0 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:09.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.121+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12b4053570 con 0x7f12c00bacf0 2023-12-19T15:14:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.335+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f12c01418f0 con 0x7f12c00bacf0 2023-12-19T15:14:09.341 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-12-19T15:14:09.341+0000 7f257b676640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T15:14:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.352+0000 7f12bcff9640 1 -- 172.21.15.6:0/2130373971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f12c01418f0 con 0x7f12c00bacf0 2023-12-19T15:14:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f12ac06a460 msgr2=0x7f12ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f12ac06a460 0x7f12ac06c920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12b0007fd0 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 msgr2=0x7f12c014e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 0x7f12c014e820 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f12b400c760 tx=0x7f12b400cc20 comp rx=0 tx=0).stop 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 shutdown_connections 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f12ac06a460 0x7f12ac06c920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12c0140f40 0x7f12c01dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12c00bacf0 0x7f12c014e820 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.354+0000 7f12c645f640 1 --2- 172.21.15.6:0/2130373971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12c00b8340 0x7f12c01390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.355+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 >> 172.21.15.6:0/2130373971 conn(0x7f12c00c0370 msgr2=0x7f12c00c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.355+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 shutdown_connections 2023-12-19T15:14:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.355+0000 7f12c645f640 1 -- 172.21.15.6:0/2130373971 wait complete. 2023-12-19T15:14:09.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T15:14:09.420 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-12-19T15:14:09.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.477+0000 7f57a0096640 1 Processor -- start 2023-12-19T15:14:09.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.477+0000 7f57a0096640 1 -- start start 2023-12-19T15:14:09.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f57a0096640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57980be410 0x7f579814e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f57a0096640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980b9420 con 0x7f57980ba4e0 2023-12-19T15:14:09.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f57a0096640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980b9670 con 0x7f579806b820 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f57a0096640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57980b8bd0 con 0x7f57980be410 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f579de32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57980be410 0x7f579814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f579d631640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f57980ba4e0 0x7f57980b7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39190/0 (socket says 172.21.15.6:39190) 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f579d631640 1 -- 172.21.15.6:0/2591461157 learned_addr learned my addr 172.21.15.6:0/2591461157 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f579de32640 1 -- 172.21.15.6:0/2591461157 >> v1:172.21.15.89:6789/0 conn(0x7f579806b820 legacy=0x7f5798155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f579de32640 1 -- 172.21.15.6:0/2591461157 >> v1:172.21.15.6:6789/0 conn(0x7f57980ba4e0 legacy=0x7f57980b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.478+0000 7f579de32640 1 -- 172.21.15.6:0/2591461157 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579806b020 con 0x7f57980be410 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.479+0000 7f579de32640 1 --2- 172.21.15.6:0/2591461157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57980be410 0x7f579814e290 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5788009d90 tx=0x7f578802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a023c07495ea401 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.479+0000 7f579ce30640 1 -- 172.21.15.6:0/2591461157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578802cd00 con 0x7f57980be410 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.479+0000 7f579ce30640 1 -- 172.21.15.6:0/2591461157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578802ce60 con 0x7f57980be410 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.479+0000 7f579ce30640 1 -- 172.21.15.6:0/2591461157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788034660 con 0x7f57980be410 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 -- 172.21.15.6:0/2591461157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57980be410 msgr2=0x7f579814e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 --2- 172.21.15.6:0/2591461157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57980be410 0x7f579814e290 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5788009d90 tx=0x7f578802bf50 comp rx=0 tx=0).stop 2023-12-19T15:14:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 -- 172.21.15.6:0/2591461157 shutdown_connections 2023-12-19T15:14:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 --2- 172.21.15.6:0/2591461157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57980be410 0x7f579814e290 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 -- 172.21.15.6:0/2591461157 >> 172.21.15.6:0/2591461157 conn(0x7f5798069ee0 msgr2=0x7f579806a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 -- 172.21.15.6:0/2591461157 shutdown_connections 2023-12-19T15:14:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.480+0000 7f57a0096640 1 -- 172.21.15.6:0/2591461157 wait complete. 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.481+0000 7f57a0096640 1 Processor -- start 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.481+0000 7f57a0096640 1 -- start start 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 0x7f5798140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57980ba4e0 0x7f57981416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57980be410 0x7f579813fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579814bb00 con 0x7f579806b820 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798140db0 con 0x7f57980ba4e0 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579814b8f0 con 0x7f57980be410 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 0x7f5798140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 0x7f5798140870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36144/0 (socket says 172.21.15.6:36144) 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 -- 172.21.15.6:0/3105381646 learned_addr learned my addr 172.21.15.6:0/3105381646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579e633640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57980be410 0x7f579813fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579d631640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57980ba4e0 0x7f57981416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 -- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57980be410 msgr2=0x7f579813fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57980be410 0x7f579813fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 -- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57980ba4e0 msgr2=0x7f57981416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57980ba4e0 0x7f57981416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 -- 172.21.15.6:0/3105381646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009a70 con 0x7f579806b820 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579e633640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57980be410 0x7f579813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579d631640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57980ba4e0 0x7f57981416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f579de32640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 0x7f5798140870 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5788037040 tx=0x7f5788004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578803d600 con 0x7f579806b820 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578803d760 con 0x7f579806b820 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578803db10 con 0x7f579806b820 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.482+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579814a8c0 con 0x7f579806b820 2023-12-19T15:14:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.483+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579813f830 con 0x7f579806b820 2023-12-19T15:14:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.483+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5798073a40 con 0x7f579806b820 2023-12-19T15:14:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.484+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f578803b040 con 0x7f579806b820 2023-12-19T15:14:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.484+0000 7f57967fc640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f578406a460 0x7f578406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.484+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f57880aa900 con 0x7f579806b820 2023-12-19T15:14:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.485+0000 7f579d631640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f578406a460 0x7f578406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.485+0000 7f579d631640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f578406a460 0x7f578406c920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f579813edd0 tx=0x7f578c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:09.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.489+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5788075e80 con 0x7f579806b820 2023-12-19T15:14:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:09.723+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f579813ee20 con 0x7f579806b820 2023-12-19T15:14:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.355+0000 7f57967fc640 1 -- 172.21.15.6:0/3105381646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f57880794a0 con 0x7f579806b820 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.357+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f578406a460 msgr2=0x7f578406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.357+0000 7f57a0096640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f578406a460 0x7f578406c920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f579813edd0 tx=0x7f578c009040 comp rx=0 tx=0).stop 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.357+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 msgr2=0x7f5798140870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 0x7f5798140870 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5788037040 tx=0x7f5788004a40 comp rx=0 tx=0).stop 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 shutdown_connections 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f578406a460 0x7f578406c920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57980be410 0x7f579813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57980ba4e0 0x7f57981416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 --2- 172.21.15.6:0/3105381646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579806b820 0x7f5798140870 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 >> 172.21.15.6:0/3105381646 conn(0x7f5798069ee0 msgr2=0x7f57980b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 shutdown_connections 2023-12-19T15:14:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.358+0000 7f57a0096640 1 -- 172.21.15.6:0/3105381646 wait complete. 2023-12-19T15:14:10.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T15:14:10.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.479+0000 7f98beee5640 1 Processor -- start 2023-12-19T15:14:10.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.479+0000 7f98beee5640 1 -- start start 2023-12-19T15:14:10.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98beee5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b80b9220 0x7f98b814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:10.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98beee5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b8070570 con 0x7f98b814afe0 2023-12-19T15:14:10.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98beee5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b80719e0 con 0x7f98b8069f70 2023-12-19T15:14:10.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98beee5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b814b470 con 0x7f98b80b9220 2023-12-19T15:14:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98bd482640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f98b814afe0 0x7f98b8155330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39194/0 (socket says 172.21.15.6:39194) 2023-12-19T15:14:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98bd482640 1 -- 172.21.15.6:0/3314699462 learned_addr learned my addr 172.21.15.6:0/3314699462 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98b7fff640 1 --2- 172.21.15.6:0/3314699462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b80b9220 0x7f98b814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990769117 0 0) 0x7f98b8070570 con 0x7f98b814afe0 2023-12-19T15:14:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.480+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a8003520 con 0x7f98b814afe0 2023-12-19T15:14:10.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.481+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378300407 0 0) 0x7f98b80719e0 con 0x7f98b8069f70 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.481+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b8070570 con 0x7f98b8069f70 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.481+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3109594730 0 0) 0x7f98a8003520 con 0x7f98b814afe0 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.481+0000 7f98b7fff640 1 -- 172.21.15.6:0/3314699462 >> v1:172.21.15.89:6789/0 conn(0x7f98b8069f70 legacy=0x7f98b8144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.481+0000 7f98b7fff640 1 -- 172.21.15.6:0/3314699462 >> v1:172.21.15.6:6789/0 conn(0x7f98b814afe0 legacy=0x7f98b8155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.481+0000 7f98b7fff640 1 -- 172.21.15.6:0/3314699462 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b806ff60 con 0x7f98b80b9220 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98b7fff640 1 --2- 172.21.15.6:0/3314699462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b80b9220 0x7f98b814aaa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98a40097d0 tx=0x7f98a402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b30a06ebe273890f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:10.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00019f0 con 0x7f98b80b9220 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4031580 con 0x7f98b80b9220 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98b77fe640 1 -- 172.21.15.6:0/3314699462 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4031910 con 0x7f98b80b9220 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 -- 172.21.15.6:0/3314699462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b80b9220 msgr2=0x7f98b814aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 --2- 172.21.15.6:0/3314699462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b80b9220 0x7f98b814aaa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98a40097d0 tx=0x7f98a402b8a0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 -- 172.21.15.6:0/3314699462 shutdown_connections 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 --2- 172.21.15.6:0/3314699462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b80b9220 0x7f98b814aaa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 -- 172.21.15.6:0/3314699462 >> 172.21.15.6:0/3314699462 conn(0x7f98b806ae10 msgr2=0x7f98b806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 -- 172.21.15.6:0/3314699462 shutdown_connections 2023-12-19T15:14:10.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.482+0000 7f98beee5640 1 -- 172.21.15.6:0/3314699462 wait complete. 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.483+0000 7f98beee5640 1 Processor -- start 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.483+0000 7f98beee5640 1 -- start start 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98beee5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b8069f70 0x7f98b8147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98beee5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 0x7f98b809d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98beee5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b814afe0 0x7f98b81e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98beee5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b81481e0 con 0x7f98b80b9220 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98beee5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b809cf70 con 0x7f98b8069f70 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98beee5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80a0330 con 0x7f98b814afe0 2023-12-19T15:14:10.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 0x7f98b809d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 0x7f98b809d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36160/0 (socket says 172.21.15.6:36160) 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.484+0000 7f98b7fff640 1 -- 172.21.15.6:0/2022482944 learned_addr learned my addr 172.21.15.6:0/2022482944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98bcc81640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b8069f70 0x7f98b8147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98bd482640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b814afe0 0x7f98b81e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b7fff640 1 -- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b814afe0 msgr2=0x7f98b81e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b7fff640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b814afe0 0x7f98b81e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b7fff640 1 -- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b8069f70 msgr2=0x7f98b8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:10.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b7fff640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b8069f70 0x7f98b8147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b7fff640 1 -- 172.21.15.6:0/2022482944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4009400 con 0x7f98b80b9220 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b7fff640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 0x7f98b809d400 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f98a40098f0 tx=0x7f98a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4004030 con 0x7f98b80b9220 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4004190 con 0x7f98b80b9220 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b809e7b0 con 0x7f98b80b9220 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4003610 con 0x7f98b80b9220 2023-12-19T15:14:10.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.485+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b809ed70 con 0x7f98b80b9220 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.486+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b8073a40 con 0x7f98b80b9220 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.487+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98a4043070 con 0x7f98b80b9220 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.487+0000 7f98b57fa640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f989c06a430 0x7f989c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.487+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f98a40aa8c0 con 0x7f98b80b9220 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.488+0000 7f98bcc81640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f989c06a430 0x7f989c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.488+0000 7f98bcc81640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f989c06a430 0x7f989c06c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0011e0 tx=0x7f98ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.491+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f98a4075fe0 con 0x7f98b80b9220 2023-12-19T15:14:10.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:10.669+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f98b806dbb0 con 0x7f98b80b9220 2023-12-19T15:14:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.525+0000 7f98b57fa640 1 -- 172.21.15.6:0/2022482944 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f98a4079600 con 0x7f98b80b9220 2023-12-19T15:14:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-12-19T15:14:11.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f989c06a430 msgr2=0x7f989c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f989c06a430 0x7f989c06c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0011e0 tx=0x7f98ac009040 comp rx=0 tx=0).stop 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 msgr2=0x7f98b809d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 0x7f98b809d400 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f98a40098f0 tx=0x7f98a40046c0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 shutdown_connections 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f989c06a430 0x7f989c06c8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b814afe0 0x7f98b81e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98b80b9220 0x7f98b809d400 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 --2- 172.21.15.6:0/2022482944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b8069f70 0x7f98b8147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 >> 172.21.15.6:0/2022482944 conn(0x7f98b806ae10 msgr2=0x7f98b814a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 shutdown_connections 2023-12-19T15:14:11.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.533+0000 7f98beee5640 1 -- 172.21.15.6:0/2022482944 wait complete. 2023-12-19T15:14:11.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T15:14:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.678+0000 7fe036dd9640 1 Processor -- start 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.678+0000 7fe036dd9640 1 -- start start 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe036dd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300b7a40 0x7fe0300b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe036dd9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0300bad10 0x7fe03014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe036dd9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0301410f0 0x7fe030141540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe036dd9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300b8da0 con 0x7fe0301410f0 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe036dd9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300b9ea0 con 0x7fe0300bad10 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe036dd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03014b930 con 0x7fe0300b7a40 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe035376640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0301410f0 0x7fe030141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe035376640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0301410f0 0x7fe030141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36172/0 (socket says 172.21.15.6:36172) 2023-12-19T15:14:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.679+0000 7fe035376640 1 -- 172.21.15.6:0/4260151775 learned_addr learned my addr 172.21.15.6:0/4260151775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe034b75640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300b7a40 0x7fe0300b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe02ffff640 1 --2- 172.21.15.6:0/4260151775 >> v2:172.21.15.89:3300/0 conn(0x7fe0300bad10 0x7fe03014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe035376640 1 -- 172.21.15.6:0/4260151775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300b7a40 msgr2=0x7fe0300b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe035376640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300b7a40 0x7fe0300b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe035376640 1 -- 172.21.15.6:0/4260151775 >> v2:172.21.15.89:3300/0 conn(0x7fe0300bad10 msgr2=0x7fe03014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe035376640 1 --2- 172.21.15.6:0/4260151775 >> v2:172.21.15.89:3300/0 conn(0x7fe0300bad10 0x7fe03014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe035376640 1 -- 172.21.15.6:0/4260151775 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300b8ac0 con 0x7fe0301410f0 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe034b75640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300b7a40 0x7fe0300b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe02ffff640 1 --2- 172.21.15.6:0/4260151775 >> v2:172.21.15.89:3300/0 conn(0x7fe0300bad10 0x7fe03014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe035376640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0301410f0 0x7fe030141540 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe03008a240 tx=0x7fe02802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450fc1490677878a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe02f7fe640 1 -- 172.21.15.6:0/4260151775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02802cb00 con 0x7fe0301410f0 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.680+0000 7fe02f7fe640 1 -- 172.21.15.6:0/4260151775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02802cc60 con 0x7fe0301410f0 2023-12-19T15:14:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe02f7fe640 1 -- 172.21.15.6:0/4260151775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280343f0 con 0x7fe0301410f0 2023-12-19T15:14:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 -- 172.21.15.6:0/4260151775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0301410f0 msgr2=0x7fe030141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0301410f0 0x7fe030141540 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe03008a240 tx=0x7fe02802bf60 comp rx=0 tx=0).stop 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 -- 172.21.15.6:0/4260151775 shutdown_connections 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0301410f0 0x7fe030141540 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 --2- 172.21.15.6:0/4260151775 >> v2:172.21.15.89:3300/0 conn(0x7fe0300bad10 0x7fe03014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 --2- 172.21.15.6:0/4260151775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300b7a40 0x7fe0300b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 -- 172.21.15.6:0/4260151775 >> 172.21.15.6:0/4260151775 conn(0x7fe0300c0390 msgr2=0x7fe0300c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 -- 172.21.15.6:0/4260151775 shutdown_connections 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.681+0000 7fe036dd9640 1 -- 172.21.15.6:0/4260151775 wait complete. 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.682+0000 7fe036dd9640 1 Processor -- start 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.682+0000 7fe036dd9640 1 -- start start 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe036dd9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 0x7fe0300bd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe036dd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300bad10 0x7fe030144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe036dd9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0301410f0 0x7fe030144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe036dd9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300bd850 con 0x7fe0300b7a40 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe036dd9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe030140480 con 0x7fe0301410f0 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe036dd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03014d570 con 0x7fe0300bad10 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 0x7fe0300bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 0x7fe0300bd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36176/0 (socket says 172.21.15.6:36176) 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 -- 172.21.15.6:0/2704498922 learned_addr learned my addr 172.21.15.6:0/2704498922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe035376640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0301410f0 0x7fe030144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe02ffff640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300bad10 0x7fe030144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 -- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300bad10 msgr2=0x7fe030144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300bad10 0x7fe030144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 -- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0301410f0 msgr2=0x7fe030144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0301410f0 0x7fe030144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.683+0000 7fe034b75640 1 -- 172.21.15.6:0/2704498922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028009b30 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.684+0000 7fe034b75640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 0x7fe0300bd310 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c7f0 tx=0x7fe02400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.684+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024007a30 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.684+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024007b90 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.684+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03014d850 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.684+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400ce40 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.684+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03014de10 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.685+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe030073a40 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.685+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0240113f0 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.685+0000 7fe02d7fa640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe01406a430 0x7fe01406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.686+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fe0240888f0 con 0x7fe0300b7a40 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.686+0000 7fe02ffff640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe01406a430 0x7fe01406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.686+0000 7fe02ffff640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe01406a430 0x7fe01406c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe030140ce0 tx=0x7fe01c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.690+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0240540f0 con 0x7fe0300b7a40 2023-12-19T15:14:11.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:11.867+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe03014ee30 con 0x7fe0300b7a40 2023-12-19T15:14:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.526+0000 7fe02d7fa640 1 -- 172.21.15.6:0/2704498922 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe02401f0d0 con 0x7fe0300b7a40 2023-12-19T15:14:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.530+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe01406a430 msgr2=0x7fe01406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.530+0000 7fe036dd9640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe01406a430 0x7fe01406c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe030140ce0 tx=0x7fe01c008040 comp rx=0 tx=0).stop 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.530+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 msgr2=0x7fe0300bd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.530+0000 7fe036dd9640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 0x7fe0300bd310 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c7f0 tx=0x7fe02400cbf0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 shutdown_connections 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe01406a430 0x7fe01406c8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0301410f0 0x7fe030144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0300bad10 0x7fe030144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 --2- 172.21.15.6:0/2704498922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0300b7a40 0x7fe0300bd310 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 >> 172.21.15.6:0/2704498922 conn(0x7fe0300c0390 msgr2=0x7fe03013e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 shutdown_connections 2023-12-19T15:14:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.531+0000 7fe036dd9640 1 -- 172.21.15.6:0/2704498922 wait complete. 2023-12-19T15:14:12.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T15:14:12.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 Processor -- start 2023-12-19T15:14:12.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 -- start start 2023-12-19T15:14:12.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ddc06b0f0 0x7f3ddc06b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:12.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ddc142610 0x7f3ddc142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:12.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0712a0 con 0x7f3ddc0b69a0 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc070790 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.695+0000 7f3de3241640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc06bac0 con 0x7f3ddc142610 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3ddbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ddc06b0f0 0x7f3ddc06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3de0fdd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3ddc0b69a0 0x7f3ddc070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:56700/0 (socket says 172.21.15.6:56700) 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3de0fdd640 1 -- 172.21.15.6:0/1530327376 learned_addr learned my addr 172.21.15.6:0/1530327376 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3de17de640 1 --2- 172.21.15.6:0/1530327376 >> v2:172.21.15.89:3300/0 conn(0x7f3ddc142610 0x7f3ddc142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3ddbfff640 1 -- 172.21.15.6:0/1530327376 >> v2:172.21.15.89:3300/0 conn(0x7f3ddc142610 msgr2=0x7f3ddc142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3ddbfff640 1 --2- 172.21.15.6:0/1530327376 >> v2:172.21.15.89:3300/0 conn(0x7f3ddc142610 0x7f3ddc142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3ddbfff640 1 -- 172.21.15.6:0/1530327376 >> v1:172.21.15.89:6789/0 conn(0x7f3ddc0b69a0 legacy=0x7f3ddc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.696+0000 7f3ddbfff640 1 -- 172.21.15.6:0/1530327376 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc071510 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.697+0000 7f3ddbfff640 1 --2- 172.21.15.6:0/1530327376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc06b580 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0097a0 tx=0x7f3dcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d790694938d5cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.697+0000 7f3ddb7fe640 1 -- 172.21.15.6:0/1530327376 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc031830 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.697+0000 7f3ddb7fe640 1 -- 172.21.15.6:0/1530327376 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc031990 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.697+0000 7f3ddb7fe640 1 -- 172.21.15.6:0/1530327376 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc031d20 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 -- 172.21.15.6:0/1530327376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 msgr2=0x7f3ddc06b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 --2- 172.21.15.6:0/1530327376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc06b580 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0097a0 tx=0x7f3dcc02b8d0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 -- 172.21.15.6:0/1530327376 shutdown_connections 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 --2- 172.21.15.6:0/1530327376 >> v2:172.21.15.89:3300/0 conn(0x7f3ddc142610 0x7f3ddc142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 --2- 172.21.15.6:0/1530327376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc06b580 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 -- 172.21.15.6:0/1530327376 >> 172.21.15.6:0/1530327376 conn(0x7f3ddc0b9d00 msgr2=0x7f3ddc0ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 -- 172.21.15.6:0/1530327376 shutdown_connections 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.698+0000 7f3de3241640 1 -- 172.21.15.6:0/1530327376 wait complete. 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.699+0000 7f3de3241640 1 Processor -- start 2023-12-19T15:14:12.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.700+0000 7f3de3241640 1 -- start start 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de3241640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc1d3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de3241640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ddc0b69a0 0x7f3ddc1dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de3241640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc142610 0x7f3ddc1e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de3241640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1d35d0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de3241640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1d3b60 con 0x7f3ddc142610 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de3241640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1d56a0 con 0x7f3ddc0b69a0 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc1d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de17de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc142610 0x7f3ddc1e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:12.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc1d3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36198/0 (socket says 172.21.15.6:36198) 2023-12-19T15:14:12.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 -- 172.21.15.6:0/3066360228 learned_addr learned my addr 172.21.15.6:0/3066360228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:12.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3ddbfff640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ddc0b69a0 0x7f3ddc1dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:12.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 -- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ddc0b69a0 msgr2=0x7f3ddc1dfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ddc0b69a0 0x7f3ddc1dfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 -- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc142610 msgr2=0x7f3ddc1e0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc142610 0x7f3ddc1e0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.701+0000 7f3de0fdd640 1 -- 172.21.15.6:0/3066360228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009400 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.702+0000 7f3de0fdd640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc1d3090 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400cb10 tx=0x7f3dd400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.702+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400ac70 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.702+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd400add0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.702+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc1d50e0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.702+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4012620 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.702+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc149a00 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.703+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc1d52d0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.704+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3dd4007070 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.704+0000 7f3dd97fa640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3dbc06a460 0x7f3dbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:12.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.704+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3dd4088480 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.705+0000 7f3ddbfff640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3dbc06a460 0x7f3dbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:12.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.705+0000 7f3ddbfff640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3dbc06a460 0x7f3dbc06c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc036000 tx=0x7f3dcc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:12.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.710+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3dd4053eb0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.954+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3ddc071aa0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.959+0000 7f3dd97fa640 1 -- 172.21.15.6:0/3066360228 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3dd40170a0 con 0x7f3ddc06b0f0 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.961+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3dbc06a460 msgr2=0x7f3dbc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.961+0000 7f3de3241640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3dbc06a460 0x7f3dbc06c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc036000 tx=0x7f3dcc03c040 comp rx=0 tx=0).stop 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.961+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 msgr2=0x7f3ddc1d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.961+0000 7f3de3241640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc1d3090 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400cb10 tx=0x7f3dd400a060 comp rx=0 tx=0).stop 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 shutdown_connections 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f3dbc06a460 0x7f3dbc06c920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ddc142610 0x7f3ddc1e0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ddc0b69a0 0x7f3ddc1dfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 --2- 172.21.15.6:0/3066360228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ddc06b0f0 0x7f3ddc1d3090 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 >> 172.21.15.6:0/3066360228 conn(0x7f3ddc0b9d00 msgr2=0x7f3ddc0b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 shutdown_connections 2023-12-19T15:14:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:12.962+0000 7f3de3241640 1 -- 172.21.15.6:0/3066360228 wait complete. 2023-12-19T15:14:12.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-19T15:14:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.080+0000 7f5b41c30640 1 Processor -- start 2023-12-19T15:14:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b41c30640 1 -- start start 2023-12-19T15:14:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b41c30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 0x7f5b3c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b41c30640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0bb310 con 0x7f5b3c0ba550 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b41c30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0bf960 con 0x7f5b3c06a6d0 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b41c30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0bb5b0 con 0x7f5b3c1544e0 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b3affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b3c0ba550 0x7f5b3c0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39206/0 (socket says 172.21.15.6:39206) 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.081+0000 7f5b3affd640 1 -- 172.21.15.6:0/840792456 learned_addr learned my addr 172.21.15.6:0/840792456 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 0x7f5b3c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634762903 0 0) 0x7f5b3c0bb310 con 0x7f5b3c0ba550 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b28003520 con 0x7f5b3c0ba550 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301795240 0 0) 0x7f5b28003520 con 0x7f5b3c0ba550 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 msgr2=0x7f5b3c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 0x7f5b3c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 >> v1:172.21.15.89:6789/0 conn(0x7f5b3c06a6d0 legacy=0x7f5b3c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0c0120 con 0x7f5b3c0ba550 2023-12-19T15:14:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f5b2c001670 con 0x7f5b3c0ba550 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 >> v1:172.21.15.6:6789/0 conn(0x7f5b3c0ba550 legacy=0x7f5b3c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b280039a0 0x7f5b28003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 0x7f5b280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28004d00 0x7f5b28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0bb5b0 con 0x7f5b28004d00 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800b980 con 0x7f5b280039a0 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800bb40 con 0x7f5b3c1544e0 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28004d00 0x7f5b28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3affd640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 0x7f5b280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3b7fe640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b280039a0 0x7f5b28003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 -- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 msgr2=0x7f5b280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c1544e0 0x7f5b280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 -- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b280039a0 msgr2=0x7f5b28003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b280039a0 0x7f5b28003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.082+0000 7f5b3bfff640 1 -- 172.21.15.6:0/840792456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28003520 con 0x7f5b28004d00 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.083+0000 7f5b3bfff640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28004d00 0x7f5b28005180 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009fc0 tx=0x7f5b280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177ec9632bb47b04 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.083+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3402cc20 con 0x7f5b28004d00 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.083+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3400f040 con 0x7f5b28004d00 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.083+0000 7f5b3a7fc640 1 -- 172.21.15.6:0/840792456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34034440 con 0x7f5b28004d00 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b41c30640 1 -- 172.21.15.6:0/840792456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28004d00 msgr2=0x7f5b28005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b41c30640 1 --2- 172.21.15.6:0/840792456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28004d00 0x7f5b28005180 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009fc0 tx=0x7f5b280057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b3bfff640 1 -- 172.21.15.6:0/840792456 reap_dead start 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b41c30640 1 -- 172.21.15.6:0/840792456 shutdown_connections 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b41c30640 1 -- 172.21.15.6:0/840792456 >> 172.21.15.6:0/840792456 conn(0x7f5b3c0c0350 msgr2=0x7f5b3c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b41c30640 1 -- 172.21.15.6:0/840792456 shutdown_connections 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.084+0000 7f5b41c30640 1 -- 172.21.15.6:0/840792456 wait complete. 2023-12-19T15:14:13.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.086+0000 7f5b41c30640 1 Processor -- start 2023-12-19T15:14:13.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.086+0000 7f5b41c30640 1 -- start start 2023-12-19T15:14:13.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b41c30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 0x7f5b3c0a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b41c30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c0a43f0 0x7f5b3c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b41c30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 0x7f5b3c1dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b41c30640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0a3a90 con 0x7f5b3c0b2e40 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b41c30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0c0760 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b41c30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0c0970 con 0x7f5b3c0a43f0 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 0x7f5b3c1dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 0x7f5b3c0a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 0x7f5b3c1dfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36210/0 (socket says 172.21.15.6:36210) 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 0x7f5b3c0a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.6:60904/0 (socket says 172.21.15.6:60904) 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3bfff640 1 -- 172.21.15.6:0/1487004599 learned_addr learned my addr 172.21.15.6:0/1487004599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3affd640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c0a43f0 0x7f5b3c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 -- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c0a43f0 msgr2=0x7f5b3c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c0a43f0 0x7f5b3c0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 -- 172.21.15.6:0/1487004599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 msgr2=0x7f5b3c1dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 0x7f5b3c1dfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 -- 172.21.15.6:0/1487004599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0a4850 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3bfff640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 0x7f5b3c1dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3affd640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c0a43f0 0x7f5b3c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b3b7fe640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 0x7f5b3c0a3eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400f7f0 tx=0x7f5b2400fbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.087+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24005110 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.088+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b24005270 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.088+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c0a33d0 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.088+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24007050 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.088+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c0b65b0 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.089+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c073a40 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.089+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b240071d0 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.089+0000 7f5b33fff640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b1c06a460 0x7f5b1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.090+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5b24087e10 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.090+0000 7f5b3affd640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b1c06a460 0x7f5b1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.090+0000 7f5b3affd640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b1c06a460 0x7f5b1c06c920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0bede0 tx=0x7f5b2c001150 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.094+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b24053820 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.356+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f5b3c0a62d0 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.537+0000 7f5b33fff640 1 -- 172.21.15.6:0/1487004599 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v3083) v1 ==== 163+0+0 (secure 0 0 0) 0x7f5b24056e40 con 0x7f5b3c1e34f0 2023-12-19T15:14:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b1c06a460 msgr2=0x7f5b1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b1c06a460 0x7f5b1c06c920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0bede0 tx=0x7f5b2c001150 comp rx=0 tx=0).stop 2023-12-19T15:14:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 msgr2=0x7f5b3c0a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 0x7f5b3c0a3eb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400f7f0 tx=0x7f5b2400fbf0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 shutdown_connections 2023-12-19T15:14:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f5b1c06a460 0x7f5b1c06c920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c0b2e40 0x7f5b3c1dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c0a43f0 0x7f5b3c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 --2- 172.21.15.6:0/1487004599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c1e34f0 0x7f5b3c0a3eb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 >> 172.21.15.6:0/1487004599 conn(0x7f5b3c0c0350 msgr2=0x7f5b3c0b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 shutdown_connections 2023-12-19T15:14:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:13.539+0000 7f5b41c30640 1 -- 172.21.15.6:0/1487004599 wait complete. 2023-12-19T15:14:13.550 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... FAIL 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner: 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner: 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T15:14:13.551 INFO:tasks.cephfs_test_runner:Ran 1 test in 6043.664s 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner: 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner: 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-12-19T15:14:13.552 INFO:tasks.cephfs_test_runner: 2023-12-19T15:14:13.552 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T15:14:13.621 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5b51daa51e3e45bc860ef33a24a8572d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T15:14:13.622 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T15:14:13.633 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-19T15:14:13.641 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-19T15:14:13.641 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-12-19T15:14:13.641 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T15:14:13.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T15:14:13.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:13.706 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-12-19T15:14:13.871 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T15:14:13.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:13.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T15:14:13.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T15:14:13.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-12-19T15:14:14.107 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T15:14:14.118 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T15:14:14.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T15:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.267+0000 7f977b727640 1 Processor -- start 2023-12-19T15:14:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.267+0000 7f977b727640 1 -- start start 2023-12-19T15:14:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f977b727640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97740ba3a0 0x7f977406f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f977b727640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f977414ca90 0x7f977406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f977b727640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740ba780 con 0x7f97740b46e0 2023-12-19T15:14:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f977b727640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977406f900 con 0x7f977414ca90 2023-12-19T15:14:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f977b727640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977414c600 con 0x7f97740ba3a0 2023-12-19T15:14:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f9779cc4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f97740b46e0 0x7f97740b4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39214/0 (socket says 172.21.15.6:39214) 2023-12-19T15:14:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.268+0000 7f9779cc4640 1 -- 172.21.15.6:0/2953796937 learned_addr learned my addr 172.21.15.6:0/2953796937 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.269+0000 7f9778cc2640 1 --2- 172.21.15.6:0/2953796937 >> v2:172.21.15.6:3300/0 conn(0x7f977414ca90 0x7f977406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.269+0000 7f97794c3640 1 --2- 172.21.15.6:0/2953796937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97740ba3a0 0x7f977406f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.269+0000 7f976bfff640 1 -- 172.21.15.6:0/2953796937 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900934339 0 0) 0x7f97740ba780 con 0x7f97740b46e0 2023-12-19T15:14:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.269+0000 7f976bfff640 1 -- 172.21.15.6:0/2953796937 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760003520 con 0x7f97740b46e0 2023-12-19T15:14:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.270+0000 7f97794c3640 1 -- 172.21.15.6:0/2953796937 >> v2:172.21.15.6:3300/0 conn(0x7f977414ca90 msgr2=0x7f977406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.270+0000 7f976bfff640 1 -- 172.21.15.6:0/2953796937 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1207969509 0 0) 0x7f9760003520 con 0x7f97740b46e0 2023-12-19T15:14:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.270+0000 7f97794c3640 1 --2- 172.21.15.6:0/2953796937 >> v2:172.21.15.6:3300/0 conn(0x7f977414ca90 0x7f977406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.270+0000 7f97794c3640 1 -- 172.21.15.6:0/2953796937 >> v1:172.21.15.6:6789/0 conn(0x7f97740b46e0 legacy=0x7f97740b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.270+0000 7f97794c3640 1 -- 172.21.15.6:0/2953796937 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977406ce20 con 0x7f97740ba3a0 2023-12-19T15:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.270+0000 7f9778cc2640 1 --2- 172.21.15.6:0/2953796937 >> v2:172.21.15.6:3300/0 conn(0x7f977414ca90 0x7f977406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.271+0000 7f97794c3640 1 --2- 172.21.15.6:0/2953796937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97740ba3a0 0x7f977406f230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f976c009d90 tx=0x7f976c02bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00f78f62f629113 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.271+0000 7f976bfff640 1 -- 172.21.15.6:0/2953796937 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770001670 con 0x7f97740ba3a0 2023-12-19T15:14:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.271+0000 7f976bfff640 1 -- 172.21.15.6:0/2953796937 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c02c8a0 con 0x7f97740ba3a0 2023-12-19T15:14:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.271+0000 7f976bfff640 1 -- 172.21.15.6:0/2953796937 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02cc30 con 0x7f97740ba3a0 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.272+0000 7f977b727640 1 -- 172.21.15.6:0/2953796937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97740ba3a0 msgr2=0x7f977406f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.272+0000 7f977b727640 1 --2- 172.21.15.6:0/2953796937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97740ba3a0 0x7f977406f230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f976c009d90 tx=0x7f976c02bd70 comp rx=0 tx=0).stop 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.273+0000 7f977b727640 1 -- 172.21.15.6:0/2953796937 shutdown_connections 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.273+0000 7f977b727640 1 --2- 172.21.15.6:0/2953796937 >> v2:172.21.15.6:3300/0 conn(0x7f977414ca90 0x7f977406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.273+0000 7f977b727640 1 --2- 172.21.15.6:0/2953796937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97740ba3a0 0x7f977406f230 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f976c009d90 tx=0x7f976c02bd70 comp rx=0 tx=0).stop 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.273+0000 7f977b727640 1 -- 172.21.15.6:0/2953796937 >> 172.21.15.6:0/2953796937 conn(0x7f97740bac30 msgr2=0x7f97740bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.273+0000 7f977b727640 1 -- 172.21.15.6:0/2953796937 shutdown_connections 2023-12-19T15:14:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.273+0000 7f977b727640 1 -- 172.21.15.6:0/2953796937 wait complete. 2023-12-19T15:14:14.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.275+0000 7f977b727640 1 Processor -- start 2023-12-19T15:14:14.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.275+0000 7f977b727640 1 -- start start 2023-12-19T15:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f977b727640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97740b46e0 0x7f977414af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f977b727640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 0x7f97740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f977b727640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740a1020 0x7f9774135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f977b727640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977414b490 con 0x7f97740a1020 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f977b727640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740b7d60 con 0x7f97740b46e0 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f977b727640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740a2b40 con 0x7f977414ca90 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f9778cc2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 0x7f97740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f9779cc4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740a1020 0x7f9774135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f97794c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97740b46e0 0x7f977414af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f9778cc2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 0x7f97740b7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:54022/0 (socket says 172.21.15.6:54022) 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.276+0000 7f9778cc2640 1 -- 172.21.15.6:0/3751558018 learned_addr learned my addr 172.21.15.6:0/3751558018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9778cc2640 1 -- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97740b46e0 msgr2=0x7f977414af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9778cc2640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97740b46e0 0x7f977414af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9778cc2640 1 -- 172.21.15.6:0/3751558018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740a1020 msgr2=0x7f9774135a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9778cc2640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740a1020 0x7f9774135a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9778cc2640 1 -- 172.21.15.6:0/3751558018 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764009400 con 0x7f977414ca90 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f97794c3640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97740b46e0 0x7f977414af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9779cc4640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740a1020 0x7f9774135a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9778cc2640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 0x7f97740b7820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f976400e990 tx=0x7f976400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400c9e0 con 0x7f977414ca90 2023-12-19T15:14:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.277+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c009a70 con 0x7f977414ca90 2023-12-19T15:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.278+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97741e7e70 con 0x7f977414ca90 2023-12-19T15:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.278+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976400cb40 con 0x7f977414ca90 2023-12-19T15:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.279+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400ced0 con 0x7f977414ca90 2023-12-19T15:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.279+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977406ec50 con 0x7f977414ca90 2023-12-19T15:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.279+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9764013470 con 0x7f977414ca90 2023-12-19T15:14:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.280+0000 7f9769ffb640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f975806a430 0x7f975806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.280+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9764088890 con 0x7f977414ca90 2023-12-19T15:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.280+0000 7f97794c3640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f975806a430 0x7f975806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.280+0000 7f97794c3640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f975806a430 0x7f975806c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f976c036000 tx=0x7f976c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.284+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f97640541a0 con 0x7f977414ca90 2023-12-19T15:14:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.484+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f977414c290 con 0x7f975806a430 2023-12-19T15:14:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.486+0000 7f9769ffb640 1 -- 172.21.15.6:0/3751558018 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50495 (secure 0 0 0) 0x7f976c043070 con 0x7f975806a430 2023-12-19T15:14:14.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T15:14:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f975806a430 msgr2=0x7f975806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f975806a430 0x7f975806c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f976c036000 tx=0x7f976c030000 comp rx=0 tx=0).stop 2023-12-19T15:14:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 msgr2=0x7f97740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 0x7f97740b7820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f976400e990 tx=0x7f976400ee50 comp rx=0 tx=0).stop 2023-12-19T15:14:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 shutdown_connections 2023-12-19T15:14:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f975806a430 0x7f975806c8f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740a1020 0x7f9774135a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f977414ca90 0x7f97740b7820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 --2- 172.21.15.6:0/3751558018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97740b46e0 0x7f977414af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 >> 172.21.15.6:0/3751558018 conn(0x7f97740bac30 msgr2=0x7f97740b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 shutdown_connections 2023-12-19T15:14:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.489+0000 7f977b727640 1 -- 172.21.15.6:0/3751558018 wait complete. 2023-12-19T15:14:14.503 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":3065,"stamp":"2023-12-19T15:14:13.447448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9068272,"kb_used_data":1475120,"kb_used_omap":1216,"kb_used_meta":7591871,"kb_avail":745906448,"statfs":{"total":773094113280,"available":763808202752,"internally_reserved":0,"allocated":1510522880,"data_stored":1508704950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1246071,"internal_metadata":7774076041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753216781,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66314,"num_read_kb":-54112292,"num_write":-2262167,"num_write_kb":-61071545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001645"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T15:13:36.165153+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T15:13:36.165153+0000","last_peered":"2023-12-19T15:13:36.165153+0000","last_clean":"2023-12-19T15:13:36.165153+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T15:13:36.165153+0000","last_undegraded":"2023-12-19T15:13:36.165153+0000","last_fullsized":"2023-12-19T15:13:36.165153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576061,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1159884,"kb_used_data":170052,"kb_used_omap":8,"kb_used_meta":989815,"kb_avail":93211956,"statfs":{"total":96636764160,"available":95449042944,"internally_reserved":0,"allocated":174133248,"data_stored":173904717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8659,"internal_metadata":1013571117},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.501,"15min":0.55200000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.9129999999999998,"5min":2.9129999999999998,"15min":23.206},"last":0.31},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.27400000000000002},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.60999999999999999,"15min":0.54700000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.60199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.6720000000000002,"5min":3.6720000000000002,"15min":22.962},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.315},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.29699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":10.459},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.63100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.694,"5min":3.694,"15min":23.106999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.629,"15min":0.65500000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.28399999999999997},"max":{"1min":5.8799999999999999,"5min":5.8799999999999999,"15min":22.995999999999999},"last":0.37}]},{"osd":4,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.495,"15min":0.60899999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61199999999999999,"5min":0.80800000000000005,"15min":23.079999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.503,"15min":0.61699999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.84299999999999997,"15min":23.245000000000001},"last":0.439}]},{"osd":5,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":5.2510000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.66300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":23.02},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61599999999999999,"15min":0.69599999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":23.053000000000001},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834576067,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1792684,"kb_used_data":168996,"kb_used_omap":0,"kb_used_meta":1623680,"kb_avail":92579156,"statfs":{"total":96636764160,"available":94801055744,"internally_reserved":0,"allocated":173051904,"data_stored":172824223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1662648320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":7.4489999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49399999999999999,"15min":0.53500000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":5.8579999999999997},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.54500000000000004,"15min":0.67200000000000004},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":6.0010000000000003,"5min":6.0010000000000003,"15min":22.858000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.57399999999999995,"15min":0.66700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":21.678000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.66500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":21.081},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":5.1989999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.63900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":21.175000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":5.266},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.77400000000000002,"15min":0.78500000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76800000000000002,"5min":0.84599999999999997,"15min":3.7549999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.27500000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":19.489999999999998},"last":0.501},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":7.9569999999999999},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834576063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602024,"kb_used_data":185440,"kb_used_omap":6,"kb_used_meta":416569,"kb_avail":93769816,"statfs":{"total":96636764160,"available":96020291584,"internally_reserved":0,"allocated":189890560,"data_stored":189662935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7151,"internal_metadata":426566673},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":10.920999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":6.4180000000000001,"5min":6.4180000000000001,"15min":6.4180000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":19.231000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.129,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.56799999999999995,"15min":0.60999999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.367,"5min":6.367,"15min":9.9290000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.079,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33700000000000002},"max":{"1min":10.906000000000001,"5min":10.906000000000001,"15min":19.166},"last":0.40000000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.61899999999999999,"15min":0.66400000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":19.443999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.085,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.25800000000000001},"max":{"1min":11.797000000000001,"5min":11.797000000000001,"15min":19.207000000000001},"last":0.496}]},{"osd":4,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27000000000000002},"max":{"1min":8.0850000000000009,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.624}]},{"osd":6,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.60299999999999998,"15min":0.58499999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8220000000000001,"5min":7.8220000000000001,"15min":7.8220000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":4.9550000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.63,"15min":0.69599999999999995},"min":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.5049999999999999,"5min":6.5049999999999999,"15min":19.268999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":7.7510000000000003,"5min":7.7510000000000003,"15min":7.7510000000000003},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834576063,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767784,"kb_used_data":225888,"kb_used_omap":9,"kb_used_meta":541878,"kb_avail":93604056,"statfs":{"total":96636764160,"available":95850553344,"internally_reserved":0,"allocated":231309312,"data_stored":231081119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9784,"internal_metadata":554883528},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.48999999999999999,"15min":0.51500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.80600000000000005,"5min":3.613,"15min":8.8569999999999993},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46300000000000002,"15min":0.57499999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.49299999999999999,"5min":0.72799999999999998,"15min":12.231999999999999},"last":0.437}]},{"osd":1,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64600000000000002,"5min":2.1509999999999998,"15min":2.1960000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":2.085,"15min":2.4180000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.495,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":2.3730000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50800000000000001,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":8.8330000000000002},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54500000000000004,"5min":10.359,"15min":12.275},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.53600000000000003,"15min":0.624},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":9.0269999999999992},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.50800000000000001,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.246},"max":{"1min":0.86399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.48899999999999999,"15min":0.60399999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.749,"15min":12.298},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51700000000000002,"15min":0.61499999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.26600000000000001},"max":{"1min":0.67600000000000005,"5min":0.75600000000000001,"15min":15.207000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.55300000000000005,"15min":0.626},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":8.7959999999999994},"last":0.66300000000000003}]},{"osd":7,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54800000000000004,"15min":0.66300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":18.420999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.782,"15min":15.164999999999999},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834576063,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":803820,"kb_used_data":231204,"kb_used_omap":59,"kb_used_meta":572548,"kb_avail":93568020,"statfs":{"total":96636764160,"available":95813652480,"internally_reserved":0,"allocated":236752896,"data_stored":236520329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60700,"internal_metadata":586289892},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.371,"15min":0.54300000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20999999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":31.536000000000001},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.39000000000000001,"15min":0.57599999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.23599999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":31.611000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.38300000000000001,"15min":0.50600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":3.875,"5min":3.875,"15min":22.16},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.41599999999999998,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24099999999999999},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":10.189},"last":0.376}]},{"osd":2,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.496},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.22700000000000001},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":22.777000000000001},"last":0.31},{"interface":"front","average":{"1min":0.63,"5min":0.42199999999999999,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":9.4830000000000005},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57499999999999996,"15min":0.68600000000000005},"min":{"1min":0.38500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":13.738},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.626,"15min":0.67900000000000005},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":3.9279999999999999,"5min":3.9279999999999999,"15min":9.3439999999999994},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.63200000000000001,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":10.439},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.70899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":10.253},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.64500000000000002,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":5.585},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.67700000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":9.5180000000000007},"last":0.77200000000000002}]},{"osd":7,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.76400000000000001},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":22.117000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.623,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":9.7390000000000008},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834576065,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1755644,"kb_used_data":145844,"kb_used_omap":0,"kb_used_meta":1609792,"kb_avail":92616196,"statfs":{"total":96636764160,"available":94838984704,"internally_reserved":0,"allocated":149344256,"data_stored":149123202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1648427008},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.224,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":1.357,"5min":1.357,"15min":5.1779999999999999},"last":0.248},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.35999999999999999},"min":{"1min":0.251,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":8.5459999999999994},"last":0.314}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.39500000000000002},"min":{"1min":0.23999999999999999,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":6.367},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.23300000000000001},"max":{"1min":1.401,"5min":1.401,"15min":5.2859999999999996},"last":0.37}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.40799999999999997,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.26900000000000002},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":8.1910000000000007},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27000000000000002},"max":{"1min":1.498,"5min":1.498,"15min":5.3129999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.60099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.311},"max":{"1min":1.468,"5min":1.468,"15min":5.2169999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":7.1580000000000004,"5min":7.1580000000000004,"15min":10.959},"last":0.54200000000000004}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.623,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.589,"5min":3.589,"15min":6.407},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.627},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":5.2450000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":7.048,"5min":7.048,"15min":8.4979999999999993},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":11.66},"last":0.625}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.212,"5min":1.212,"15min":8.5239999999999991},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.496,"5min":3.496,"15min":20.228000000000002},"last":0.60299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834576063,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":702816,"kb_used_data":207448,"kb_used_omap":1132,"kb_used_meta":494227,"kb_avail":93669024,"statfs":{"total":96636764160,"available":95917080576,"internally_reserved":0,"allocated":212426752,"data_stored":212195053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159777,"internal_metadata":506088863},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.51600000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":4.306,"5min":4.306,"15min":38.348999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.54300000000000004,"15min":0.76900000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.048,"5min":9.0150000000000006,"15min":73.376000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.48799999999999999,"15min":0.65300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.186},"max":{"1min":3.0510000000000002,"5min":3.9140000000000001,"15min":68.296000000000006},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61799999999999999,"15min":0.80800000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":1.7070000000000001,"5min":9.0839999999999996,"15min":73.349999999999994},"last":0.34399999999999997}]},{"osd":3,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":3.8679999999999999,"15min":8.282},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":1.038},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.3529999999999998,"5min":5.9290000000000003,"15min":72.754999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":18.861000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77100000000000002,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.3879999999999999,"5min":5.9560000000000004,"15min":72.823999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":1.0580000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.35199999999999998},"max":{"1min":4.4180000000000001,"5min":6.008,"15min":72.792000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":3.101,"5min":4.1790000000000003,"15min":5.9710000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89800000000000002,"5min":4.0300000000000002,"15min":13.942},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.755},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.5920000000000001,"5min":4.1479999999999997,"15min":22.631},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834576065,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483616,"kb_used_data":140248,"kb_used_omap":0,"kb_used_meta":1343360,"kb_avail":92888224,"statfs":{"total":96636764160,"available":95117541376,"internally_reserved":0,"allocated":143613952,"data_stored":143393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1375600640},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":7.0730000000000004,"5min":7.0730000000000004,"15min":11.076000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.875,"5min":1.3819999999999999,"15min":9.5969999999999995},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.51500000000000001,"15min":0.58299999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.1509999999999998,"5min":7.1509999999999998,"15min":30.41},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24399999999999999},"max":{"1min":13.970000000000001,"5min":13.970000000000001,"15min":13.970000000000001},"last":0.31}]},{"osd":3,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.2919999999999998,"5min":9.984,"15min":15.484},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.1299999999999999,"5min":12.144,"15min":12.144},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57999999999999996,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":9.109},"last":0.495},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.72199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.125,"5min":2.04,"15min":18.951000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":11.426,"5min":11.426,"15min":11.426},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":12.074999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.1059999999999999,"5min":7.1059999999999999,"15min":9.4429999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":9.6340000000000003},"last":0.59299999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":7.3550000000000004,"5min":7.3550000000000004,"15min":12.129},"last":0.625},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":7.3540000000000001},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T15:14:14.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T15:14:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.611+0000 7fadaa0d5640 1 Processor -- start 2023-12-19T15:14:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.611+0000 7fadaa0d5640 1 -- start start 2023-12-19T15:14:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.611+0000 7fadaa0d5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fada406f230 0x7fada406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.611+0000 7fadaa0d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40ba780 con 0x7fada414ca90 2023-12-19T15:14:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.611+0000 7fadaa0d5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada406f900 con 0x7fada40ba3a0 2023-12-19T15:14:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.611+0000 7fadaa0d5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada414c600 con 0x7fada406f230 2023-12-19T15:14:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fad9affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fada414ca90 0x7fada4151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39226/0 (socket says 172.21.15.6:39226) 2023-12-19T15:14:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fad9affd640 1 -- 172.21.15.6:0/2455563585 learned_addr learned my addr 172.21.15.6:0/2455563585 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada3fff640 1 --2- 172.21.15.6:0/2455563585 >> v2:172.21.15.89:3300/0 conn(0x7fada406f230 0x7fada406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948436729 0 0) 0x7fada40ba780 con 0x7fada414ca90 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad90003520 con 0x7fada414ca90 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240968486 0 0) 0x7fada406f900 con 0x7fada40ba3a0 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada40ba780 con 0x7fada40ba3a0 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada3fff640 1 -- 172.21.15.6:0/2455563585 >> v1:172.21.15.89:6789/0 conn(0x7fada40ba3a0 legacy=0x7fada40b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada3fff640 1 -- 172.21.15.6:0/2455563585 >> v1:172.21.15.6:6789/0 conn(0x7fada414ca90 legacy=0x7fada4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.612+0000 7fada3fff640 1 -- 172.21.15.6:0/2455563585 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada406f660 con 0x7fada406f230 2023-12-19T15:14:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.613+0000 7fada3fff640 1 --2- 172.21.15.6:0/2455563585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada406f230 0x7fada406d7b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009d90 tx=0x7fad9c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b2636770707050 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.613+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c02cd00 con 0x7fada406f230 2023-12-19T15:14:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.613+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c02ce60 con 0x7fada406f230 2023-12-19T15:14:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.613+0000 7fada2ffd640 1 -- 172.21.15.6:0/2455563585 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c034660 con 0x7fada406f230 2023-12-19T15:14:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 -- 172.21.15.6:0/2455563585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada406f230 msgr2=0x7fada406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/2455563585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada406f230 0x7fada406d7b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009d90 tx=0x7fad9c02bf50 comp rx=0 tx=0).stop 2023-12-19T15:14:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 -- 172.21.15.6:0/2455563585 shutdown_connections 2023-12-19T15:14:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/2455563585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada406f230 0x7fada406d7b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 -- 172.21.15.6:0/2455563585 >> 172.21.15.6:0/2455563585 conn(0x7fada40bac30 msgr2=0x7fada40bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 -- 172.21.15.6:0/2455563585 shutdown_connections 2023-12-19T15:14:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.614+0000 7fadaa0d5640 1 -- 172.21.15.6:0/2455563585 wait complete. 2023-12-19T15:14:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.615+0000 7fadaa0d5640 1 Processor -- start 2023-12-19T15:14:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 -- start start 2023-12-19T15:14:14.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406f230 0x7fada413eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 0x7fada41de670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada414ca90 0x7fada41debb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada41de1e0 con 0x7fada40ba3a0 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada414a660 con 0x7fada414ca90 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.616+0000 7fadaa0d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada413d3c0 con 0x7fada406f230 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 0x7fada41de670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 0x7fada41de670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36252/0 (socket says 172.21.15.6:36252) 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 -- 172.21.15.6:0/1079448381 learned_addr learned my addr 172.21.15.6:0/1079448381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:14.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fada3fff640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada414ca90 0x7fada41debb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fada37fe640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406f230 0x7fada413eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 -- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406f230 msgr2=0x7fada413eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406f230 0x7fada413eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 -- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada414ca90 msgr2=0x7fada41debb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada414ca90 0x7fada41debb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 -- 172.21.15.6:0/1079448381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c009a70 con 0x7fada40ba3a0 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fad9affd640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 0x7fada41de670 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c410 tx=0x7fad8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c005ce0 con 0x7fada40ba3a0 2023-12-19T15:14:14.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c005e40 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada413d6a0 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0072d0 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.617+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada413f570 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.618+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada41de350 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.619+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad8c007430 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.619+0000 7fada0ff9640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fad8406a430 0x7fad8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.620+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad8c087b20 con 0x7fada40ba3a0 2023-12-19T15:14:14.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.620+0000 7fada37fe640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fad8406a430 0x7fad8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.620+0000 7fada37fe640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fad8406a430 0x7fad8406c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad940011e0 tx=0x7fad94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.623+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad8c056f50 con 0x7fada40ba3a0 2023-12-19T15:14:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.798+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fada413d530 con 0x7fad8406a430 2023-12-19T15:14:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.800+0000 7fada0ff9640 1 -- 172.21.15.6:0/1079448381 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50495 (secure 0 0 0) 0x7fada413d530 con 0x7fad8406a430 2023-12-19T15:14:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:14.801 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T15:14:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fad8406a430 msgr2=0x7fad8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fad8406a430 0x7fad8406c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad940011e0 tx=0x7fad94009040 comp rx=0 tx=0).stop 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 msgr2=0x7fada41de670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 0x7fada41de670 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c410 tx=0x7fad8c00c8d0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 shutdown_connections 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fad8406a430 0x7fad8406c8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada414ca90 0x7fada41debb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada40ba3a0 0x7fada41de670 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 --2- 172.21.15.6:0/1079448381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406f230 0x7fada413eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 >> 172.21.15.6:0/1079448381 conn(0x7fada40bac30 msgr2=0x7fada40bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 shutdown_connections 2023-12-19T15:14:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.802+0000 7fadaa0d5640 1 -- 172.21.15.6:0/1079448381 wait complete. 2023-12-19T15:14:14.813 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":3065,"stamp":"2023-12-19T15:14:13.447448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9068272,"kb_used_data":1475120,"kb_used_omap":1216,"kb_used_meta":7591871,"kb_avail":745906448,"statfs":{"total":773094113280,"available":763808202752,"internally_reserved":0,"allocated":1510522880,"data_stored":1508704950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1246071,"internal_metadata":7774076041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753216781,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66314,"num_read_kb":-54112292,"num_write":-2262167,"num_write_kb":-61071545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001645"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T15:13:36.165153+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T15:13:36.165153+0000","last_peered":"2023-12-19T15:13:36.165153+0000","last_clean":"2023-12-19T15:13:36.165153+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T15:13:36.165153+0000","last_undegraded":"2023-12-19T15:13:36.165153+0000","last_fullsized":"2023-12-19T15:13:36.165153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576061,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1159884,"kb_used_data":170052,"kb_used_omap":8,"kb_used_meta":989815,"kb_avail":93211956,"statfs":{"total":96636764160,"available":95449042944,"internally_reserved":0,"allocated":174133248,"data_stored":173904717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8659,"internal_metadata":1013571117},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.501,"15min":0.55200000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.9129999999999998,"5min":2.9129999999999998,"15min":23.206},"last":0.31},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.27400000000000002},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.60999999999999999,"15min":0.54700000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.60199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.6720000000000002,"5min":3.6720000000000002,"15min":22.962},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.315},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.29699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":10.459},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.63100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.694,"5min":3.694,"15min":23.106999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.629,"15min":0.65500000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.28399999999999997},"max":{"1min":5.8799999999999999,"5min":5.8799999999999999,"15min":22.995999999999999},"last":0.37}]},{"osd":4,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.495,"15min":0.60899999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61199999999999999,"5min":0.80800000000000005,"15min":23.079999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.503,"15min":0.61699999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.84299999999999997,"15min":23.245000000000001},"last":0.439}]},{"osd":5,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":5.2510000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.66300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":23.02},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61599999999999999,"15min":0.69599999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":23.053000000000001},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834576067,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1792684,"kb_used_data":168996,"kb_used_omap":0,"kb_used_meta":1623680,"kb_avail":92579156,"statfs":{"total":96636764160,"available":94801055744,"internally_reserved":0,"allocated":173051904,"data_stored":172824223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1662648320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":7.4489999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49399999999999999,"15min":0.53500000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":5.8579999999999997},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.54500000000000004,"15min":0.67200000000000004},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":6.0010000000000003,"5min":6.0010000000000003,"15min":22.858000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.57399999999999995,"15min":0.66700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":21.678000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.66500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":21.081},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":5.1989999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.63900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":21.175000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":5.266},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.77400000000000002,"15min":0.78500000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76800000000000002,"5min":0.84599999999999997,"15min":3.7549999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.27500000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":19.489999999999998},"last":0.501},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":7.9569999999999999},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834576063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602024,"kb_used_data":185440,"kb_used_omap":6,"kb_used_meta":416569,"kb_avail":93769816,"statfs":{"total":96636764160,"available":96020291584,"internally_reserved":0,"allocated":189890560,"data_stored":189662935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7151,"internal_metadata":426566673},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":10.920999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":6.4180000000000001,"5min":6.4180000000000001,"15min":6.4180000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":19.231000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.129,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.56799999999999995,"15min":0.60999999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.367,"5min":6.367,"15min":9.9290000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.079,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33700000000000002},"max":{"1min":10.906000000000001,"5min":10.906000000000001,"15min":19.166},"last":0.40000000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.61899999999999999,"15min":0.66400000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":19.443999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.085,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.25800000000000001},"max":{"1min":11.797000000000001,"5min":11.797000000000001,"15min":19.207000000000001},"last":0.496}]},{"osd":4,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27000000000000002},"max":{"1min":8.0850000000000009,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.624}]},{"osd":6,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.60299999999999998,"15min":0.58499999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8220000000000001,"5min":7.8220000000000001,"15min":7.8220000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":4.9550000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.63,"15min":0.69599999999999995},"min":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.5049999999999999,"5min":6.5049999999999999,"15min":19.268999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":7.7510000000000003,"5min":7.7510000000000003,"15min":7.7510000000000003},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834576063,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767784,"kb_used_data":225888,"kb_used_omap":9,"kb_used_meta":541878,"kb_avail":93604056,"statfs":{"total":96636764160,"available":95850553344,"internally_reserved":0,"allocated":231309312,"data_stored":231081119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9784,"internal_metadata":554883528},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.48999999999999999,"15min":0.51500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.80600000000000005,"5min":3.613,"15min":8.8569999999999993},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46300000000000002,"15min":0.57499999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.49299999999999999,"5min":0.72799999999999998,"15min":12.231999999999999},"last":0.437}]},{"osd":1,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64600000000000002,"5min":2.1509999999999998,"15min":2.1960000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":2.085,"15min":2.4180000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.495,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":2.3730000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50800000000000001,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":8.8330000000000002},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54500000000000004,"5min":10.359,"15min":12.275},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.53600000000000003,"15min":0.624},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":9.0269999999999992},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.50800000000000001,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.246},"max":{"1min":0.86399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.48899999999999999,"15min":0.60399999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.749,"15min":12.298},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51700000000000002,"15min":0.61499999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.26600000000000001},"max":{"1min":0.67600000000000005,"5min":0.75600000000000001,"15min":15.207000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.55300000000000005,"15min":0.626},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":8.7959999999999994},"last":0.66300000000000003}]},{"osd":7,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54800000000000004,"15min":0.66300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":18.420999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.782,"15min":15.164999999999999},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834576063,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":803820,"kb_used_data":231204,"kb_used_omap":59,"kb_used_meta":572548,"kb_avail":93568020,"statfs":{"total":96636764160,"available":95813652480,"internally_reserved":0,"allocated":236752896,"data_stored":236520329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60700,"internal_metadata":586289892},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.371,"15min":0.54300000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20999999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":31.536000000000001},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.39000000000000001,"15min":0.57599999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.23599999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":31.611000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.38300000000000001,"15min":0.50600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":3.875,"5min":3.875,"15min":22.16},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.41599999999999998,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24099999999999999},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":10.189},"last":0.376}]},{"osd":2,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.496},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.22700000000000001},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":22.777000000000001},"last":0.31},{"interface":"front","average":{"1min":0.63,"5min":0.42199999999999999,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":9.4830000000000005},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57499999999999996,"15min":0.68600000000000005},"min":{"1min":0.38500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":13.738},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.626,"15min":0.67900000000000005},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":3.9279999999999999,"5min":3.9279999999999999,"15min":9.3439999999999994},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.63200000000000001,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":10.439},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.70899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":10.253},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.64500000000000002,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":5.585},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.67700000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":9.5180000000000007},"last":0.77200000000000002}]},{"osd":7,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.76400000000000001},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":22.117000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.623,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":9.7390000000000008},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834576065,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1755644,"kb_used_data":145844,"kb_used_omap":0,"kb_used_meta":1609792,"kb_avail":92616196,"statfs":{"total":96636764160,"available":94838984704,"internally_reserved":0,"allocated":149344256,"data_stored":149123202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1648427008},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.224,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":1.357,"5min":1.357,"15min":5.1779999999999999},"last":0.248},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.35999999999999999},"min":{"1min":0.251,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":8.5459999999999994},"last":0.314}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.39500000000000002},"min":{"1min":0.23999999999999999,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":6.367},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.23300000000000001},"max":{"1min":1.401,"5min":1.401,"15min":5.2859999999999996},"last":0.37}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.40799999999999997,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.26900000000000002},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":8.1910000000000007},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27000000000000002},"max":{"1min":1.498,"5min":1.498,"15min":5.3129999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.60099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.311},"max":{"1min":1.468,"5min":1.468,"15min":5.2169999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":7.1580000000000004,"5min":7.1580000000000004,"15min":10.959},"last":0.54200000000000004}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.623,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.589,"5min":3.589,"15min":6.407},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.627},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":5.2450000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":7.048,"5min":7.048,"15min":8.4979999999999993},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":11.66},"last":0.625}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.212,"5min":1.212,"15min":8.5239999999999991},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.496,"5min":3.496,"15min":20.228000000000002},"last":0.60299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834576063,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":702816,"kb_used_data":207448,"kb_used_omap":1132,"kb_used_meta":494227,"kb_avail":93669024,"statfs":{"total":96636764160,"available":95917080576,"internally_reserved":0,"allocated":212426752,"data_stored":212195053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159777,"internal_metadata":506088863},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.51600000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":4.306,"5min":4.306,"15min":38.348999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.54300000000000004,"15min":0.76900000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.048,"5min":9.0150000000000006,"15min":73.376000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.48799999999999999,"15min":0.65300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.186},"max":{"1min":3.0510000000000002,"5min":3.9140000000000001,"15min":68.296000000000006},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61799999999999999,"15min":0.80800000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":1.7070000000000001,"5min":9.0839999999999996,"15min":73.349999999999994},"last":0.34399999999999997}]},{"osd":3,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":3.8679999999999999,"15min":8.282},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":1.038},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.3529999999999998,"5min":5.9290000000000003,"15min":72.754999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":18.861000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77100000000000002,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.3879999999999999,"5min":5.9560000000000004,"15min":72.823999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":1.0580000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.35199999999999998},"max":{"1min":4.4180000000000001,"5min":6.008,"15min":72.792000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":3.101,"5min":4.1790000000000003,"15min":5.9710000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89800000000000002,"5min":4.0300000000000002,"15min":13.942},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.755},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.5920000000000001,"5min":4.1479999999999997,"15min":22.631},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834576065,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483616,"kb_used_data":140248,"kb_used_omap":0,"kb_used_meta":1343360,"kb_avail":92888224,"statfs":{"total":96636764160,"available":95117541376,"internally_reserved":0,"allocated":143613952,"data_stored":143393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1375600640},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":7.0730000000000004,"5min":7.0730000000000004,"15min":11.076000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.875,"5min":1.3819999999999999,"15min":9.5969999999999995},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.51500000000000001,"15min":0.58299999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.1509999999999998,"5min":7.1509999999999998,"15min":30.41},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24399999999999999},"max":{"1min":13.970000000000001,"5min":13.970000000000001,"15min":13.970000000000001},"last":0.31}]},{"osd":3,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.2919999999999998,"5min":9.984,"15min":15.484},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.1299999999999999,"5min":12.144,"15min":12.144},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57999999999999996,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":9.109},"last":0.495},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.72199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.125,"5min":2.04,"15min":18.951000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":11.426,"5min":11.426,"15min":11.426},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":12.074999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.1059999999999999,"5min":7.1059999999999999,"15min":9.4429999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":9.6340000000000003},"last":0.59299999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":7.3550000000000004,"5min":7.3550000000000004,"15min":12.129},"last":0.625},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":7.3540000000000001},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T15:14:14.814 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T15:14:14.815 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T15:14:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.921+0000 7f78aa04c640 1 Processor -- start 2023-12-19T15:14:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.921+0000 7f78aa04c640 1 -- start start 2023-12-19T15:14:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78aa04c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78a406f230 0x7f78a406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78aa04c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40ba780 con 0x7f78a414ca90 2023-12-19T15:14:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78aa04c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a406f900 con 0x7f78a40ba3a0 2023-12-19T15:14:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78aa04c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a414c600 con 0x7f78a406f230 2023-12-19T15:14:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78a3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78a406f230 0x7f78a406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78a3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78a406f230 0x7f78a406d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36268/0 (socket says 172.21.15.6:36268) 2023-12-19T15:14:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.922+0000 7f78a3fff640 1 -- 172.21.15.6:0/4012436891 learned_addr learned my addr 172.21.15.6:0/4012436891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.923+0000 7f78a3fff640 1 -- 172.21.15.6:0/4012436891 >> v1:172.21.15.89:6789/0 conn(0x7f78a40ba3a0 legacy=0x7f78a40b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.923+0000 7f78a3fff640 1 -- 172.21.15.6:0/4012436891 >> v1:172.21.15.6:6789/0 conn(0x7f78a414ca90 legacy=0x7f78a4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.923+0000 7f78a3fff640 1 -- 172.21.15.6:0/4012436891 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a406f660 con 0x7f78a406f230 2023-12-19T15:14:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.923+0000 7f78a3fff640 1 --2- 172.21.15.6:0/4012436891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a406f230 0x7f78a406d7b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f789c009e50 tx=0x7f789c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec86e95be86d4d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.923+0000 7f78a27fc640 1 -- 172.21.15.6:0/4012436891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c02cbb0 con 0x7f78a406f230 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78a27fc640 1 -- 172.21.15.6:0/4012436891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c02cd10 con 0x7f78a406f230 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78a27fc640 1 -- 172.21.15.6:0/4012436891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c034610 con 0x7f78a406f230 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 -- 172.21.15.6:0/4012436891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a406f230 msgr2=0x7f78a406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 --2- 172.21.15.6:0/4012436891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a406f230 0x7f78a406d7b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f789c009e50 tx=0x7f789c02c010 comp rx=0 tx=0).stop 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 -- 172.21.15.6:0/4012436891 shutdown_connections 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 --2- 172.21.15.6:0/4012436891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a406f230 0x7f78a406d7b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 -- 172.21.15.6:0/4012436891 >> 172.21.15.6:0/4012436891 conn(0x7f78a40bac30 msgr2=0x7f78a40bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 -- 172.21.15.6:0/4012436891 shutdown_connections 2023-12-19T15:14:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.924+0000 7f78aa04c640 1 -- 172.21.15.6:0/4012436891 wait complete. 2023-12-19T15:14:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.925+0000 7f78aa04c640 1 Processor -- start 2023-12-19T15:14:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.925+0000 7f78aa04c640 1 -- start start 2023-12-19T15:14:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78aa04c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406f230 0x7f78a40a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78aa04c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a40ba3a0 0x7f78a41458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78aa04c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 0x7f78a41e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78aa04c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40a2ef0 con 0x7f78a414ca90 2023-12-19T15:14:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78aa04c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41e08d0 con 0x7f78a406f230 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78aa04c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41dfd00 con 0x7f78a40ba3a0 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 0x7f78a41e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 0x7f78a41e3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36272/0 (socket says 172.21.15.6:36272) 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 -- 172.21.15.6:0/3220439228 learned_addr learned my addr 172.21.15.6:0/3220439228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a37fe640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406f230 0x7f78a40a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a2ffd640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a40ba3a0 0x7f78a41458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 -- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a40ba3a0 msgr2=0x7f78a41458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a40ba3a0 0x7f78a41458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 -- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406f230 msgr2=0x7f78a40a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406f230 0x7f78a40a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.926+0000 7f78a3fff640 1 -- 172.21.15.6:0/3220439228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009b30 con 0x7f78a414ca90 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.927+0000 7f78a3fff640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 0x7f78a41e3280 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f789c009e50 tx=0x7f789c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.927+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c009510 con 0x7f78a414ca90 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.927+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c03e450 con 0x7f78a414ca90 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.927+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c03e800 con 0x7f78a414ca90 2023-12-19T15:14:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.927+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a41dffa0 con 0x7f78a414ca90 2023-12-19T15:14:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.927+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a41e0560 con 0x7f78a414ca90 2023-12-19T15:14:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.928+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a4066e10 con 0x7f78a414ca90 2023-12-19T15:14:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.928+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f789c03e960 con 0x7f78a414ca90 2023-12-19T15:14:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.929+0000 7f789bfff640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f788406a430 0x7f788406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.929+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f789c0ab3c0 con 0x7f78a414ca90 2023-12-19T15:14:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.929+0000 7f78a37fe640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f788406a430 0x7f788406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.929+0000 7f78a37fe640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f788406a430 0x7f788406c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7894000f60 tx=0x7f7894009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:14.933+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f789c076cd0 con 0x7f78a414ca90 2023-12-19T15:14:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.106+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78a414c290 con 0x7f788406a430 2023-12-19T15:14:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.108+0000 7f789bfff640 1 -- 172.21.15.6:0/3220439228 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50495 (secure 0 0 0) 0x7f78940014a0 con 0x7f788406a430 2023-12-19T15:14:15.109 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f788406a430 msgr2=0x7f788406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f788406a430 0x7f788406c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7894000f60 tx=0x7f7894009040 comp rx=0 tx=0).stop 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 msgr2=0x7f78a41e3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 0x7f78a41e3280 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f789c009e50 tx=0x7f789c004a40 comp rx=0 tx=0).stop 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 shutdown_connections 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f788406a430 0x7f788406c8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78a414ca90 0x7f78a41e3280 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a40ba3a0 0x7f78a41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 --2- 172.21.15.6:0/3220439228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406f230 0x7f78a40a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 >> 172.21.15.6:0/3220439228 conn(0x7f78a40bac30 msgr2=0x7f78a40bd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 shutdown_connections 2023-12-19T15:14:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.110+0000 7f78aa04c640 1 -- 172.21.15.6:0/3220439228 wait complete. 2023-12-19T15:14:15.121 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":3065,"stamp":"2023-12-19T15:14:13.447448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9068272,"kb_used_data":1475120,"kb_used_omap":1216,"kb_used_meta":7591871,"kb_avail":745906448,"statfs":{"total":773094113280,"available":763808202752,"internally_reserved":0,"allocated":1510522880,"data_stored":1508704950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1246071,"internal_metadata":7774076041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753216781,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66314,"num_read_kb":-54112292,"num_write":-2262167,"num_write_kb":-61071545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001645"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T15:13:36.165153+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T15:13:36.165153+0000","last_peered":"2023-12-19T15:13:36.165153+0000","last_clean":"2023-12-19T15:13:36.165153+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T15:13:36.165153+0000","last_undegraded":"2023-12-19T15:13:36.165153+0000","last_fullsized":"2023-12-19T15:13:36.165153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576061,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1159884,"kb_used_data":170052,"kb_used_omap":8,"kb_used_meta":989815,"kb_avail":93211956,"statfs":{"total":96636764160,"available":95449042944,"internally_reserved":0,"allocated":174133248,"data_stored":173904717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8659,"internal_metadata":1013571117},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.501,"15min":0.55200000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.9129999999999998,"5min":2.9129999999999998,"15min":23.206},"last":0.31},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.27400000000000002},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.60999999999999999,"15min":0.54700000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.60199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.6720000000000002,"5min":3.6720000000000002,"15min":22.962},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.315},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.29699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":10.459},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.63100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.694,"5min":3.694,"15min":23.106999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.629,"15min":0.65500000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.28399999999999997},"max":{"1min":5.8799999999999999,"5min":5.8799999999999999,"15min":22.995999999999999},"last":0.37}]},{"osd":4,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.495,"15min":0.60899999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61199999999999999,"5min":0.80800000000000005,"15min":23.079999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.503,"15min":0.61699999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.84299999999999997,"15min":23.245000000000001},"last":0.439}]},{"osd":5,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":5.2510000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.66300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":23.02},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61599999999999999,"15min":0.69599999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":23.053000000000001},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834576067,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1792684,"kb_used_data":168996,"kb_used_omap":0,"kb_used_meta":1623680,"kb_avail":92579156,"statfs":{"total":96636764160,"available":94801055744,"internally_reserved":0,"allocated":173051904,"data_stored":172824223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1662648320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":7.4489999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49399999999999999,"15min":0.53500000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":5.8579999999999997},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.54500000000000004,"15min":0.67200000000000004},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":6.0010000000000003,"5min":6.0010000000000003,"15min":22.858000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.57399999999999995,"15min":0.66700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":21.678000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.66500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":21.081},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":5.1989999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.63900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":21.175000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":5.266},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.77400000000000002,"15min":0.78500000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76800000000000002,"5min":0.84599999999999997,"15min":3.7549999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.27500000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":19.489999999999998},"last":0.501},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":7.9569999999999999},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834576063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602024,"kb_used_data":185440,"kb_used_omap":6,"kb_used_meta":416569,"kb_avail":93769816,"statfs":{"total":96636764160,"available":96020291584,"internally_reserved":0,"allocated":189890560,"data_stored":189662935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7151,"internal_metadata":426566673},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":10.920999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":6.4180000000000001,"5min":6.4180000000000001,"15min":6.4180000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":19.231000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.129,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.56799999999999995,"15min":0.60999999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.367,"5min":6.367,"15min":9.9290000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.079,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33700000000000002},"max":{"1min":10.906000000000001,"5min":10.906000000000001,"15min":19.166},"last":0.40000000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.61899999999999999,"15min":0.66400000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":19.443999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.085,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.25800000000000001},"max":{"1min":11.797000000000001,"5min":11.797000000000001,"15min":19.207000000000001},"last":0.496}]},{"osd":4,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27000000000000002},"max":{"1min":8.0850000000000009,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.624}]},{"osd":6,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.60299999999999998,"15min":0.58499999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8220000000000001,"5min":7.8220000000000001,"15min":7.8220000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":4.9550000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.63,"15min":0.69599999999999995},"min":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.5049999999999999,"5min":6.5049999999999999,"15min":19.268999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":7.7510000000000003,"5min":7.7510000000000003,"15min":7.7510000000000003},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834576063,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":767784,"kb_used_data":225888,"kb_used_omap":9,"kb_used_meta":541878,"kb_avail":93604056,"statfs":{"total":96636764160,"available":95850553344,"internally_reserved":0,"allocated":231309312,"data_stored":231081119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9784,"internal_metadata":554883528},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.48999999999999999,"15min":0.51500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.80600000000000005,"5min":3.613,"15min":8.8569999999999993},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46300000000000002,"15min":0.57499999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.49299999999999999,"5min":0.72799999999999998,"15min":12.231999999999999},"last":0.437}]},{"osd":1,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64600000000000002,"5min":2.1509999999999998,"15min":2.1960000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":2.085,"15min":2.4180000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.495,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":2.3730000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50800000000000001,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":8.8330000000000002},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54500000000000004,"5min":10.359,"15min":12.275},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.53600000000000003,"15min":0.624},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":9.0269999999999992},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.50800000000000001,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.246},"max":{"1min":0.86399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.48899999999999999,"15min":0.60399999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.749,"15min":12.298},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51700000000000002,"15min":0.61499999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.26600000000000001},"max":{"1min":0.67600000000000005,"5min":0.75600000000000001,"15min":15.207000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.55300000000000005,"15min":0.626},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":8.7959999999999994},"last":0.66300000000000003}]},{"osd":7,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54800000000000004,"15min":0.66300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":18.420999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.782,"15min":15.164999999999999},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834576063,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":803820,"kb_used_data":231204,"kb_used_omap":59,"kb_used_meta":572548,"kb_avail":93568020,"statfs":{"total":96636764160,"available":95813652480,"internally_reserved":0,"allocated":236752896,"data_stored":236520329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60700,"internal_metadata":586289892},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.371,"15min":0.54300000000000004},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20999999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":31.536000000000001},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.39000000000000001,"15min":0.57599999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.23599999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":31.611000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.38300000000000001,"15min":0.50600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":3.875,"5min":3.875,"15min":22.16},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.41599999999999998,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24099999999999999},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":10.189},"last":0.376}]},{"osd":2,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.496},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.22700000000000001},"max":{"1min":3.9780000000000002,"5min":3.9780000000000002,"15min":22.777000000000001},"last":0.31},{"interface":"front","average":{"1min":0.63,"5min":0.42199999999999999,"15min":0.46800000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.25600000000000001},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":9.4830000000000005},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57499999999999996,"15min":0.68600000000000005},"min":{"1min":0.38500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.1110000000000002,"5min":3.1110000000000002,"15min":13.738},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.626,"15min":0.67900000000000005},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":3.9279999999999999,"5min":3.9279999999999999,"15min":9.3439999999999994},"last":0.46300000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.63200000000000001,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.33800000000000002},"max":{"1min":4.0359999999999996,"5min":4.0359999999999996,"15min":10.439},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.70899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":10.253},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.64500000000000002,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":5.585},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.67700000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":9.5180000000000007},"last":0.77200000000000002}]},{"osd":7,"last update":"Tue Dec 19 15:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.76400000000000001},"min":{"1min":0.41999999999999998,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":22.117000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.623,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":9.7390000000000008},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834576065,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1755644,"kb_used_data":145844,"kb_used_omap":0,"kb_used_meta":1609792,"kb_avail":92616196,"statfs":{"total":96636764160,"available":94838984704,"internally_reserved":0,"allocated":149344256,"data_stored":149123202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1648427008},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.224,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":1.357,"5min":1.357,"15min":5.1779999999999999},"last":0.248},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.35999999999999999},"min":{"1min":0.251,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":8.5459999999999994},"last":0.314}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.39500000000000002},"min":{"1min":0.23999999999999999,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":6.367},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.23300000000000001},"max":{"1min":1.401,"5min":1.401,"15min":5.2859999999999996},"last":0.37}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.40799999999999997,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.26900000000000002},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":8.1910000000000007},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27000000000000002},"max":{"1min":1.498,"5min":1.498,"15min":5.3129999999999997},"last":0.40600000000000003}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.60099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.311},"max":{"1min":1.468,"5min":1.468,"15min":5.2169999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":7.1580000000000004,"5min":7.1580000000000004,"15min":10.959},"last":0.54200000000000004}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.623,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.589,"5min":3.589,"15min":6.407},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.627},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":5.2450000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":7.048,"5min":7.048,"15min":8.4979999999999993},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":11.66},"last":0.625}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.212,"5min":1.212,"15min":8.5239999999999991},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.496,"5min":3.496,"15min":20.228000000000002},"last":0.60299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834576063,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":702816,"kb_used_data":207448,"kb_used_omap":1132,"kb_used_meta":494227,"kb_avail":93669024,"statfs":{"total":96636764160,"available":95917080576,"internally_reserved":0,"allocated":212426752,"data_stored":212195053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159777,"internal_metadata":506088863},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.51600000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":4.306,"5min":4.306,"15min":38.348999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.54300000000000004,"15min":0.76900000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.048,"5min":9.0150000000000006,"15min":73.376000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.48799999999999999,"15min":0.65300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.186},"max":{"1min":3.0510000000000002,"5min":3.9140000000000001,"15min":68.296000000000006},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61799999999999999,"15min":0.80800000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":1.7070000000000001,"5min":9.0839999999999996,"15min":73.349999999999994},"last":0.34399999999999997}]},{"osd":3,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":3.8679999999999999,"15min":8.282},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":1.038},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.3529999999999998,"5min":5.9290000000000003,"15min":72.754999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":18.861000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77100000000000002,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.3879999999999999,"5min":5.9560000000000004,"15min":72.823999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":1.0580000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.35199999999999998},"max":{"1min":4.4180000000000001,"5min":6.008,"15min":72.792000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":3.101,"5min":4.1790000000000003,"15min":5.9710000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89800000000000002,"5min":4.0300000000000002,"15min":13.942},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.755},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.5920000000000001,"5min":4.1479999999999997,"15min":22.631},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834576065,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483616,"kb_used_data":140248,"kb_used_omap":0,"kb_used_meta":1343360,"kb_avail":92888224,"statfs":{"total":96636764160,"available":95117541376,"internally_reserved":0,"allocated":143613952,"data_stored":143393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1375600640},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":7.0730000000000004,"5min":7.0730000000000004,"15min":11.076000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.875,"5min":1.3819999999999999,"15min":9.5969999999999995},"last":0.39500000000000002}]},{"osd":2,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.51500000000000001,"15min":0.58299999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.1509999999999998,"5min":7.1509999999999998,"15min":30.41},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24399999999999999},"max":{"1min":13.970000000000001,"5min":13.970000000000001,"15min":13.970000000000001},"last":0.31}]},{"osd":3,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.2919999999999998,"5min":9.984,"15min":15.484},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.1299999999999999,"5min":12.144,"15min":12.144},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57999999999999996,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":9.109},"last":0.495},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.72199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.125,"5min":2.04,"15min":18.951000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":11.426,"5min":11.426,"15min":11.426},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":12.074999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.1059999999999999,"5min":7.1059999999999999,"15min":9.4429999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":9.6340000000000003},"last":0.59299999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":7.3550000000000004,"5min":7.3550000000000004,"15min":12.129},"last":0.625},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":7.3540000000000001},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T15:14:15.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T15:14:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.227+0000 7ff8053b5640 1 Processor -- start 2023-12-19T15:14:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.227+0000 7ff8053b5640 1 -- start start 2023-12-19T15:14:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff8053b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff80006a6d0 0x7ff80014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff8053b5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8000ba550 0x7ff8001554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff8053b5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000bb310 con 0x7ff80014b1f0 2023-12-19T15:14:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff8053b5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8000bf960 con 0x7ff80006a6d0 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff8053b5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000bb5b0 con 0x7ff8000ba550 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff7feffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff80006a6d0 0x7ff80014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff7fe7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff80014b1f0 0x7ff8000b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39240/0 (socket says 172.21.15.6:39240) 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff7fe7fc640 1 -- 172.21.15.6:0/1375998613 learned_addr learned my addr 172.21.15.6:0/1375998613 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.228+0000 7ff7ff7fe640 1 --2- 172.21.15.6:0/1375998613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8000ba550 0x7ff8001554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.229+0000 7ff7feffd640 1 -- 172.21.15.6:0/1375998613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8000ba550 msgr2=0x7ff8001554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.229+0000 7ff7feffd640 1 --2- 172.21.15.6:0/1375998613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8000ba550 0x7ff8001554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.229+0000 7ff7feffd640 1 -- 172.21.15.6:0/1375998613 >> v1:172.21.15.6:6789/0 conn(0x7ff80014b1f0 legacy=0x7ff8000b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.229+0000 7ff7feffd640 1 -- 172.21.15.6:0/1375998613 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000c0120 con 0x7ff80006a6d0 2023-12-19T15:14:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.229+0000 7ff7fdffb640 1 -- 172.21.15.6:0/1375998613 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612939644 0 0) 0x7ff8000bb310 con 0x7ff80014b1f0 2023-12-19T15:14:15.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff7feffd640 1 --2- 172.21.15.6:0/1375998613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80006a6d0 0x7ff80014acb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80097a0 tx=0x7ff7e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a4741a32f47ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:15.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff7fdffb640 1 -- 172.21.15.6:0/1375998613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8031830 con 0x7ff80006a6d0 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff7fdffb640 1 -- 172.21.15.6:0/1375998613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8031990 con 0x7ff80006a6d0 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff7fdffb640 1 -- 172.21.15.6:0/1375998613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8031d20 con 0x7ff80006a6d0 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 -- 172.21.15.6:0/1375998613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80006a6d0 msgr2=0x7ff80014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 --2- 172.21.15.6:0/1375998613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80006a6d0 0x7ff80014acb0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80097a0 tx=0x7ff7e802b8d0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 -- 172.21.15.6:0/1375998613 shutdown_connections 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 --2- 172.21.15.6:0/1375998613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8000ba550 0x7ff8001554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 --2- 172.21.15.6:0/1375998613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80006a6d0 0x7ff80014acb0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 -- 172.21.15.6:0/1375998613 >> 172.21.15.6:0/1375998613 conn(0x7ff8000c0350 msgr2=0x7ff8000c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 -- 172.21.15.6:0/1375998613 shutdown_connections 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.230+0000 7ff8053b5640 1 -- 172.21.15.6:0/1375998613 wait complete. 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 Processor -- start 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 -- start start 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80006a6d0 0x7ff80014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 0x7ff8000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80014b1f0 0x7ff8000a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80014d390 con 0x7ff8000ba550 2023-12-19T15:14:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000a5460 con 0x7ff80006a6d0 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff8053b5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80014c270 con 0x7ff80014b1f0 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff7fe7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 0x7ff8000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff7fe7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 0x7ff8000a58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36296/0 (socket says 172.21.15.6:36296) 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.232+0000 7ff7fe7fc640 1 -- 172.21.15.6:0/3730843369 learned_addr learned my addr 172.21.15.6:0/3730843369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7feffd640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80006a6d0 0x7ff80014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7ff7fe640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80014b1f0 0x7ff8000a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7fe7fc640 1 -- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80014b1f0 msgr2=0x7ff8000a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7fe7fc640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80014b1f0 0x7ff8000a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7fe7fc640 1 -- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80006a6d0 msgr2=0x7ff80014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7fe7fc640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80006a6d0 0x7ff80014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7fe7fc640 1 -- 172.21.15.6:0/3730843369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009400 con 0x7ff8000ba550 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7feffd640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80006a6d0 0x7ff80014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7ff7fe640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80014b1f0 0x7ff8000a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7fe7fc640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 0x7ff8000a58f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c440 tx=0x7ff7f000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00074e0 con 0x7ff8000ba550 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0007640 con 0x7ff8000ba550 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8001e3430 con 0x7ff8000ba550 2023-12-19T15:14:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004a20 con 0x7ff8000ba550 2023-12-19T15:14:15.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.233+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80014c7f0 con 0x7ff8000ba550 2023-12-19T15:14:15.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.234+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8000bcb70 con 0x7ff8000ba550 2023-12-19T15:14:15.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.235+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff7f0004b80 con 0x7ff8000ba550 2023-12-19T15:14:15.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.235+0000 7ff7f77fe640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff7e006a430 0x7ff7e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:15.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.235+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff7f0087a40 con 0x7ff8000ba550 2023-12-19T15:14:15.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.235+0000 7ff7feffd640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff7e006a430 0x7ff7e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:15.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.236+0000 7ff7feffd640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff7e006a430 0x7ff7e006c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8036000 tx=0x7ff7e8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:15.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.239+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff7f0089e60 con 0x7ff8000ba550 2023-12-19T15:14:15.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.420+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff800073a40 con 0x7ff8000ba550 2023-12-19T15:14:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.421+0000 7ff7f77fe640 1 -- 172.21.15.6:0/3730843369 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12418 (secure 0 0 0) 0x7ff7f0018090 con 0x7ff8000ba550 2023-12-19T15:14:15.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:15.421 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"dcbd1077-757f-4b91-a6c2-c01c60d71a4f","created":"2023-12-19T13:32:43.855777+0000","modified":"2023-12-19T15:14:12.523662+0000","last_up_change":"2023-12-19T13:32:55.036078+0000","last_in_change":"2023-12-19T13:32:46.077967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T13:32:56.009075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7572066e-c130-4b07-a454-1c5f0f9ebaa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":89548},{"type":"v1","addr":"172.21.15.6:6809","nonce":89548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":89548},{"type":"v1","addr":"172.21.15.6:6811","nonce":89548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":89548},{"type":"v1","addr":"172.21.15.6:6815","nonce":89548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":89548},{"type":"v1","addr":"172.21.15.6:6813","nonce":89548}]},"public_addr":"172.21.15.6:6809/89548","cluster_addr":"172.21.15.6:6811/89548","heartbeat_back_addr":"172.21.15.6:6815/89548","heartbeat_front_addr":"172.21.15.6:6813/89548","state":["exists","up"]},{"osd":1,"uuid":"3c314916-8775-4069-b8a8-b98969fb7138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":89549},{"type":"v1","addr":"172.21.15.6:6817","nonce":89549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":89549},{"type":"v1","addr":"172.21.15.6:6819","nonce":89549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":89549},{"type":"v1","addr":"172.21.15.6:6827","nonce":89549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":89549},{"type":"v1","addr":"172.21.15.6:6822","nonce":89549}]},"public_addr":"172.21.15.6:6817/89549","cluster_addr":"172.21.15.6:6819/89549","heartbeat_back_addr":"172.21.15.6:6827/89549","heartbeat_front_addr":"172.21.15.6:6822/89549","state":["exists","up"]},{"osd":2,"uuid":"e9a9a409-78c2-45d9-8ca2-934f18d032ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":89547},{"type":"v1","addr":"172.21.15.6:6801","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":89547},{"type":"v1","addr":"172.21.15.6:6803","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":89547},{"type":"v1","addr":"172.21.15.6:6807","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":89547},{"type":"v1","addr":"172.21.15.6:6805","nonce":89547}]},"public_addr":"172.21.15.6:6801/89547","cluster_addr":"172.21.15.6:6803/89547","heartbeat_back_addr":"172.21.15.6:6807/89547","heartbeat_front_addr":"172.21.15.6:6805/89547","state":["exists","up"]},{"osd":3,"uuid":"9052f48d-ab33-4b57-b85e-1f7992dc7900","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":89558},{"type":"v1","addr":"172.21.15.6:6823","nonce":89558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":89558},{"type":"v1","addr":"172.21.15.6:6826","nonce":89558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":89558},{"type":"v1","addr":"172.21.15.6:6831","nonce":89558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":89558},{"type":"v1","addr":"172.21.15.6:6829","nonce":89558}]},"public_addr":"172.21.15.6:6823/89558","cluster_addr":"172.21.15.6:6826/89558","heartbeat_back_addr":"172.21.15.6:6831/89558","heartbeat_front_addr":"172.21.15.6:6829/89558","state":["exists","up"]},{"osd":4,"uuid":"a20c9448-a2c0-4f0d-a4b3-beac6638b7db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":89538},{"type":"v1","addr":"172.21.15.89:6825","nonce":89538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":89538},{"type":"v1","addr":"172.21.15.89:6827","nonce":89538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":89538},{"type":"v1","addr":"172.21.15.89:6831","nonce":89538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":89538},{"type":"v1","addr":"172.21.15.89:6829","nonce":89538}]},"public_addr":"172.21.15.89:6825/89538","cluster_addr":"172.21.15.89:6827/89538","heartbeat_back_addr":"172.21.15.89:6831/89538","heartbeat_front_addr":"172.21.15.89:6829/89538","state":["exists","up"]},{"osd":5,"uuid":"038a605f-2df7-47b5-8ca6-d6410ca02cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":89536},{"type":"v1","addr":"172.21.15.89:6801","nonce":89536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":89536},{"type":"v1","addr":"172.21.15.89:6803","nonce":89536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":89536},{"type":"v1","addr":"172.21.15.89:6807","nonce":89536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":89536},{"type":"v1","addr":"172.21.15.89:6805","nonce":89536}]},"public_addr":"172.21.15.89:6801/89536","cluster_addr":"172.21.15.89:6803/89536","heartbeat_back_addr":"172.21.15.89:6807/89536","heartbeat_front_addr":"172.21.15.89:6805/89536","state":["exists","up"]},{"osd":6,"uuid":"9201ba5a-2ddc-4b4a-9e14-8b4bf5e7a247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":89547},{"type":"v1","addr":"172.21.15.89:6817","nonce":89547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":89547},{"type":"v1","addr":"172.21.15.89:6819","nonce":89547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":89547},{"type":"v1","addr":"172.21.15.89:6823","nonce":89547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":89547},{"type":"v1","addr":"172.21.15.89:6821","nonce":89547}]},"public_addr":"172.21.15.89:6817/89547","cluster_addr":"172.21.15.89:6819/89547","heartbeat_back_addr":"172.21.15.89:6823/89547","heartbeat_front_addr":"172.21.15.89:6821/89547","state":["exists","up"]},{"osd":7,"uuid":"0b544aa1-fec3-4bff-9058-81675b9610fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":89537},{"type":"v1","addr":"172.21.15.89:6809","nonce":89537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":89537},{"type":"v1","addr":"172.21.15.89:6811","nonce":89537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":89537},{"type":"v1","addr":"172.21.15.89:6815","nonce":89537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":89537},{"type":"v1","addr":"172.21.15.89:6813","nonce":89537}]},"public_addr":"172.21.15.89:6809/89537","cluster_addr":"172.21.15.89:6811/89537","heartbeat_back_addr":"172.21.15.89:6815/89537","heartbeat_front_addr":"172.21.15.89:6813/89537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.243609+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.271125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:50.989679+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.157479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.228919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.260869+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.232188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T13:32:51.245987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/331533137":"2023-12-20T15:14:09.337339+0000","172.21.15.6:6834/331533137":"2023-12-20T15:14:09.337339+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T15:14:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff7e006a430 msgr2=0x7ff7e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff7e006a430 0x7ff7e006c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8036000 tx=0x7ff7e8008030 comp rx=0 tx=0).stop 2023-12-19T15:14:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 msgr2=0x7ff8000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 0x7ff8000a58f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c440 tx=0x7ff7f000c900 comp rx=0 tx=0).stop 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 shutdown_connections 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7ff7e006a430 0x7ff7e006c8f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80014b1f0 0x7ff8000a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8000ba550 0x7ff8000a58f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 --2- 172.21.15.6:0/3730843369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80006a6d0 0x7ff80014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 >> 172.21.15.6:0/3730843369 conn(0x7ff8000c0350 msgr2=0x7ff8000a1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 shutdown_connections 2023-12-19T15:14:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:15.423+0000 7ff8053b5640 1 -- 172.21.15.6:0/3730843369 wait complete. 2023-12-19T15:14:16.435 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T15:14:16.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.546+0000 7f7439877640 1 Processor -- start 2023-12-19T15:14:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7439877640 1 -- start start 2023-12-19T15:14:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7439877640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f743414aa00 0x7f74340bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7439877640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7434140ef0 0x7f7434141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7439877640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74341418c0 con 0x7f74340b79f0 2023-12-19T15:14:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7439877640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74340bbca0 con 0x7f743414aa00 2023-12-19T15:14:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7439877640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340bacc0 con 0x7f7434140ef0 2023-12-19T15:14:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f74327fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f743414aa00 0x7f74340bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7432ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74340b79f0 0x7f74340b83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51980/0 (socket says 172.21.15.6:51980) 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f74327fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f743414aa00 0x7f74340bb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54970/0 (socket says 172.21.15.6:54970) 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.547+0000 7f7432ffd640 1 -- 172.21.15.6:0/3821422176 learned_addr learned my addr 172.21.15.6:0/3821422176 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f74337fe640 1 --2- 172.21.15.6:0/3821422176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7434140ef0 0x7f7434141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f74327fc640 1 -- 172.21.15.6:0/3821422176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7434140ef0 msgr2=0x7f7434141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f74327fc640 1 --2- 172.21.15.6:0/3821422176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7434140ef0 0x7f7434141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f74327fc640 1 -- 172.21.15.6:0/3821422176 >> v1:172.21.15.6:6789/0 conn(0x7f74340b79f0 legacy=0x7f74340b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f74327fc640 1 -- 172.21.15.6:0/3821422176 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340bbe60 con 0x7f743414aa00 2023-12-19T15:14:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f7431ffb640 1 -- 172.21.15.6:0/3821422176 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719441168 0 0) 0x7f74341418c0 con 0x7f74340b79f0 2023-12-19T15:14:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.548+0000 7f74327fc640 1 --2- 172.21.15.6:0/3821422176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743414aa00 0x7f74340bb760 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f74240097a0 tx=0x7f742402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b761fb482603e26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7431ffb640 1 -- 172.21.15.6:0/3821422176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424030610 con 0x7f743414aa00 2023-12-19T15:14:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7431ffb640 1 -- 172.21.15.6:0/3821422176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7424030770 con 0x7f743414aa00 2023-12-19T15:14:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7431ffb640 1 -- 172.21.15.6:0/3821422176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424030b00 con 0x7f743414aa00 2023-12-19T15:14:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 -- 172.21.15.6:0/3821422176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743414aa00 msgr2=0x7f74340bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 --2- 172.21.15.6:0/3821422176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743414aa00 0x7f74340bb760 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f74240097a0 tx=0x7f742402b960 comp rx=0 tx=0).stop 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 -- 172.21.15.6:0/3821422176 shutdown_connections 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 --2- 172.21.15.6:0/3821422176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7434140ef0 0x7f7434141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 --2- 172.21.15.6:0/3821422176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743414aa00 0x7f74340bb760 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 -- 172.21.15.6:0/3821422176 >> 172.21.15.6:0/3821422176 conn(0x7f74340c0340 msgr2=0x7f74340c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 -- 172.21.15.6:0/3821422176 shutdown_connections 2023-12-19T15:14:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.549+0000 7f7439877640 1 -- 172.21.15.6:0/3821422176 wait complete. 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.550+0000 7f7439877640 1 Processor -- start 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 -- start start 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74340b79f0 0x7f743414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7434140ef0 0x7f743413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743414aa00 0x7f7434145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434140020 con 0x7f7434140ef0 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434145c60 con 0x7f74340b79f0 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7439877640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7434147210 con 0x7f743414aa00 2023-12-19T15:14:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f74327fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7434140ef0 0x7f743413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f74327fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7434140ef0 0x7f743413fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54974/0 (socket says 172.21.15.6:54974) 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f74327fc640 1 -- 172.21.15.6:0/3258384858 learned_addr learned my addr 172.21.15.6:0/3258384858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.551+0000 7f7432ffd640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74340b79f0 0x7f743414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74337fe640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743414aa00 0x7f7434145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74327fc640 1 -- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743414aa00 msgr2=0x7f7434145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74327fc640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743414aa00 0x7f7434145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74327fc640 1 -- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74340b79f0 msgr2=0x7f743414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74327fc640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74340b79f0 0x7f743414bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74327fc640 1 -- 172.21.15.6:0/3258384858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009400 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f74327fc640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7434140ef0 0x7f743413fae0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f74240097a0 tx=0x7f74240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742403f070 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7424006e10 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74341474f0 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424004250 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.552+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7434147ab0 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.553+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74340baf60 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7424043070 con 0x7f7434140ef0 2023-12-19T15:14:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f741bfff640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742006a430 0x7f742006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f74240aa2f0 con 0x7f7434140ef0 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f741bfff640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7420070290 0x7f74200726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 --> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7420072d60 con 0x7f7420070290 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74240ac9b0 con 0x7f7434140ef0 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f7432ffd640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742006a430 0x7f742006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.554+0000 7f74337fe640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7420070290 0x7f74200726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.555+0000 7f74337fe640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7420070290 0x7f74200726b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.555+0000 7f7432ffd640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742006a430 0x7f742006c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7428000f60 tx=0x7f7428007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.555+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== osd.0 v2:172.21.15.6:6808/89548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7420072d60 con 0x7f7420070290 2023-12-19T15:14:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 --> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74340b8bc0 con 0x7f7420070290 2023-12-19T15:14:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f741bfff640 1 -- 172.21.15.6:0/3258384858 <== osd.0 v2:172.21.15.6:6808/89548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f742c0083a0 con 0x7f7420070290 2023-12-19T15:14:16.568 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:16.569 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7420070290 msgr2=0x7f74200726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:6808/89548,v1:172.21.15.6:6809/89548] conn(0x7f7420070290 0x7f74200726b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742006a430 msgr2=0x7f742006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f742006a430 0x7f742006c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7428000f60 tx=0x7f7428007d50 comp rx=0 tx=0).stop 2023-12-19T15:14:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7434140ef0 msgr2=0x7f743413fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 --2- 172.21.15.6:0/3258384858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7434140ef0 0x7f743413fae0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f74240097a0 tx=0x7f74240046c0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f74337fe640 1 -- 172.21.15.6:0/3258384858 reap_dead start 2023-12-19T15:14:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 shutdown_connections 2023-12-19T15:14:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.568+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 >> 172.21.15.6:0/3258384858 conn(0x7f74340c0340 msgr2=0x7f743413ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.569+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 shutdown_connections 2023-12-19T15:14:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.569+0000 7f7439877640 1 -- 172.21.15.6:0/3258384858 wait complete. 2023-12-19T15:14:16.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T15:14:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.686+0000 7f9ec64ca640 1 Processor -- start 2023-12-19T15:14:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.686+0000 7f9ec64ca640 1 -- start start 2023-12-19T15:14:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ec64ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ec014b9c0 0x7f9ec014c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ec64ca640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ec006b020 0x7f9ec006b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ec64ca640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00bb230 con 0x7f9ec0144f80 2023-12-19T15:14:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ec64ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec014b5a0 con 0x7f9ec014b9c0 2023-12-19T15:14:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ec64ca640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00b8600 con 0x7f9ec006b020 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ec014b9c0 0x7f9ec014c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ec014b9c0 0x7f9ec014c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54990/0 (socket says 172.21.15.6:54990) 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 -- 172.21.15.6:0/4101083218 learned_addr learned my addr 172.21.15.6:0/4101083218 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ec4a67640 1 --2- 172.21.15.6:0/4101083218 >> v2:172.21.15.89:3300/0 conn(0x7f9ec006b020 0x7f9ec006b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 -- 172.21.15.6:0/4101083218 >> v2:172.21.15.89:3300/0 conn(0x7f9ec006b020 msgr2=0x7f9ec006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 --2- 172.21.15.6:0/4101083218 >> v2:172.21.15.89:3300/0 conn(0x7f9ec006b020 0x7f9ec006b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 -- 172.21.15.6:0/4101083218 >> v1:172.21.15.89:6789/0 conn(0x7f9ec0144f80 legacy=0x7f9ec00bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.687+0000 7f9ebf7fe640 1 -- 172.21.15.6:0/4101083218 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec006b990 con 0x7f9ec014b9c0 2023-12-19T15:14:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.688+0000 7f9ebf7fe640 1 --2- 172.21.15.6:0/4101083218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec014b9c0 0x7f9ec014c1d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00bbc30 tx=0x7f9ea802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b11d167b175325 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.688+0000 7f9ebeffd640 1 -- 172.21.15.6:0/4101083218 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8030860 con 0x7f9ec014b9c0 2023-12-19T15:14:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.688+0000 7f9ebeffd640 1 -- 172.21.15.6:0/4101083218 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80309c0 con 0x7f9ec014b9c0 2023-12-19T15:14:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.688+0000 7f9ebeffd640 1 -- 172.21.15.6:0/4101083218 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8030d50 con 0x7f9ec014b9c0 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.688+0000 7f9ec64ca640 1 -- 172.21.15.6:0/4101083218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec014b9c0 msgr2=0x7f9ec014c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.688+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/4101083218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec014b9c0 0x7f9ec014c1d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00bbc30 tx=0x7f9ea802b9a0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.689+0000 7f9ec64ca640 1 -- 172.21.15.6:0/4101083218 shutdown_connections 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.689+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/4101083218 >> v2:172.21.15.89:3300/0 conn(0x7f9ec006b020 0x7f9ec006b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.689+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/4101083218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec014b9c0 0x7f9ec014c1d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.689+0000 7f9ec64ca640 1 -- 172.21.15.6:0/4101083218 >> 172.21.15.6:0/4101083218 conn(0x7f9ec006ea50 msgr2=0x7f9ec006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.689+0000 7f9ec64ca640 1 -- 172.21.15.6:0/4101083218 shutdown_connections 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.689+0000 7f9ec64ca640 1 -- 172.21.15.6:0/4101083218 wait complete. 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 Processor -- start 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 -- start start 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 0x7f9ec00bd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec0144f80 0x7f9ec00b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec014b9c0 0x7f9ec01e37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01daa10 con 0x7f9ec006b020 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00bbf90 con 0x7f9ec0144f80 2023-12-19T15:14:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.690+0000 7f9ec64ca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00bece0 con 0x7f9ec014b9c0 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 0x7f9ec00bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 0x7f9ec00bd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54992/0 (socket says 172.21.15.6:54992) 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 -- 172.21.15.6:0/2091380963 learned_addr learned my addr 172.21.15.6:0/2091380963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebf7fe640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec0144f80 0x7f9ec00b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ec4a67640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec014b9c0 0x7f9ec01e37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 -- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec014b9c0 msgr2=0x7f9ec01e37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec014b9c0 0x7f9ec01e37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 -- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec0144f80 msgr2=0x7f9ec00b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec0144f80 0x7f9ec00b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 -- 172.21.15.6:0/2091380963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80094d0 con 0x7f9ec006b020 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebffff640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 0x7f9ec00bd010 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000c450 tx=0x7f9eb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00052d0 con 0x7f9ec006b020 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0005430 con 0x7f9ec006b020 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00bc1e0 con 0x7f9ec006b020 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0012870 con 0x7f9ec006b020 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.691+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00bd550 con 0x7f9ec006b020 2023-12-19T15:14:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.692+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec00bdb20 con 0x7f9ec006b020 2023-12-19T15:14:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.693+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9eb00129d0 con 0x7f9ec006b020 2023-12-19T15:14:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.693+0000 7f9ebcff9640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9ea006a430 0x7f9ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.693+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9eb0087f00 con 0x7f9ec006b020 2023-12-19T15:14:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.693+0000 7f9ebf7fe640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9ea006a430 0x7f9ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.694+0000 7f9ebf7fe640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9ea006a430 0x7f9ea006c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8036000 tx=0x7f9ea8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.697+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9eb0053930 con 0x7f9ec006b020 2023-12-19T15:14:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.873+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ec014b1c0 con 0x7f9ea006a430 2023-12-19T15:14:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.874+0000 7f9ebcff9640 1 -- 172.21.15.6:0/2091380963 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9ea8030bb0 con 0x7f9ea006a430 2023-12-19T15:14:16.874 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T15:14:16.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9ea006a430 msgr2=0x7f9ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9ea006a430 0x7f9ea006c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8036000 tx=0x7f9ea8008030 comp rx=0 tx=0).stop 2023-12-19T15:14:16.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 msgr2=0x7f9ec00bd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:16.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 0x7f9ec00bd010 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000c450 tx=0x7f9eb000c910 comp rx=0 tx=0).stop 2023-12-19T15:14:16.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 shutdown_connections 2023-12-19T15:14:16.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f9ea006a430 0x7f9ea006c8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec014b9c0 0x7f9ec01e37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec0144f80 0x7f9ec00b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 --2- 172.21.15.6:0/2091380963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec006b020 0x7f9ec00bd010 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 >> 172.21.15.6:0/2091380963 conn(0x7f9ec006ea50 msgr2=0x7f9ec014a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 shutdown_connections 2023-12-19T15:14:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.876+0000 7f9ec64ca640 1 -- 172.21.15.6:0/2091380963 wait complete. 2023-12-19T15:14:16.887 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T15:14:16.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 Processor -- start 2023-12-19T15:14:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 -- start start 2023-12-19T15:14:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1694148680 0x7f169406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16940b3a50 0x7f1694152270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16941481f0 con 0x7f1694071240 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16941479d0 con 0x7f16940b3a50 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.997+0000 7f169c7c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1694070600 con 0x7f1694148680 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16940b3a50 0x7f1694152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16940b3a50 0x7f1694152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54998/0 (socket says 172.21.15.6:54998) 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 -- 172.21.15.6:0/1037114359 learned_addr learned my addr 172.21.15.6:0/1037114359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169a565640 1 --1- 172.21.15.6:0/1037114359 >> v1:172.21.15.6:6789/0 conn(0x7f1694071240 0x7f16940b2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51986/0 (socket says 172.21.15.6:51986) 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f1699d64640 1 --2- 172.21.15.6:0/1037114359 >> v2:172.21.15.89:3300/0 conn(0x7f1694148680 0x7f169406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 -- 172.21.15.6:0/1037114359 >> v2:172.21.15.89:3300/0 conn(0x7f1694148680 msgr2=0x7f169406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 --2- 172.21.15.6:0/1037114359 >> v2:172.21.15.89:3300/0 conn(0x7f1694148680 0x7f169406fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 -- 172.21.15.6:0/1037114359 >> v1:172.21.15.6:6789/0 conn(0x7f1694071240 legacy=0x7f16940b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f169ad66640 1 -- 172.21.15.6:0/1037114359 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694147be0 con 0x7f16940b3a50 2023-12-19T15:14:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.998+0000 7f1699563640 1 -- 172.21.15.6:0/1037114359 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821091109 0 0) 0x7f16941481f0 con 0x7f1694071240 2023-12-19T15:14:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f169ad66640 1 --2- 172.21.15.6:0/1037114359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16940b3a50 0x7f1694152270 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f16940b2890 tx=0x7f168c02e210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b27933599c79a4e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f1699563640 1 -- 172.21.15.6:0/1037114359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00b0d0 con 0x7f16940b3a50 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f1699563640 1 -- 172.21.15.6:0/1037114359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c00b230 con 0x7f16940b3a50 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f1699563640 1 -- 172.21.15.6:0/1037114359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c009600 con 0x7f16940b3a50 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f169c7c9640 1 -- 172.21.15.6:0/1037114359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16940b3a50 msgr2=0x7f1694152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f169c7c9640 1 --2- 172.21.15.6:0/1037114359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16940b3a50 0x7f1694152270 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f16940b2890 tx=0x7f168c02e210 comp rx=0 tx=0).stop 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:16.999+0000 7f169c7c9640 1 -- 172.21.15.6:0/1037114359 shutdown_connections 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.000+0000 7f169c7c9640 1 --2- 172.21.15.6:0/1037114359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16940b3a50 0x7f1694152270 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.000+0000 7f169c7c9640 1 --2- 172.21.15.6:0/1037114359 >> v2:172.21.15.89:3300/0 conn(0x7f1694148680 0x7f169406fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.000+0000 7f169c7c9640 1 -- 172.21.15.6:0/1037114359 >> 172.21.15.6:0/1037114359 conn(0x7f169406ae10 msgr2=0x7f169406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.000+0000 7f169c7c9640 1 -- 172.21.15.6:0/1037114359 shutdown_connections 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.000+0000 7f169c7c9640 1 -- 172.21.15.6:0/1037114359 wait complete. 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 Processor -- start 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 -- start start 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1694071240 0x7f169414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16940b3a50 0x7f16941416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1694148680 0x7f16941e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1694141be0 con 0x7f1694071240 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169414aac0 con 0x7f16940b3a50 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169c7c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169414a1b0 con 0x7f1694148680 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169a565640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1694071240 0x7f169414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169a565640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1694071240 0x7f169414b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55004/0 (socket says 172.21.15.6:55004) 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.001+0000 7f169a565640 1 -- 172.21.15.6:0/1828922551 learned_addr learned my addr 172.21.15.6:0/1828922551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169ad66640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1694148680 0x7f16941e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f1699d64640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16940b3a50 0x7f16941416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169a565640 1 -- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1694148680 msgr2=0x7f16941e29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169a565640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1694148680 0x7f16941e29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169a565640 1 -- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16940b3a50 msgr2=0x7f16941416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169a565640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16940b3a50 0x7f16941416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169a565640 1 -- 172.21.15.6:0/1828922551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c00bd40 con 0x7f1694071240 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169a565640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1694071240 0x7f169414b740 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f168400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840074e0 con 0x7f1694071240 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684007660 con 0x7f1694071240 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169414a470 con 0x7f1694071240 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684004a20 con 0x7f1694071240 2023-12-19T15:14:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.002+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940a02c0 con 0x7f1694071240 2023-12-19T15:14:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.003+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1694147e80 con 0x7f1694071240 2023-12-19T15:14:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.004+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1684004b80 con 0x7f1694071240 2023-12-19T15:14:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.004+0000 7f168affd640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f167806a430 0x7f167806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.004+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1684088e00 con 0x7f1694071240 2023-12-19T15:14:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.004+0000 7f168affd640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1678070290 0x7f16780726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.004+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 --> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1678072d60 con 0x7f1678070290 2023-12-19T15:14:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.004+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1684089250 con 0x7f1694071240 2023-12-19T15:14:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.005+0000 7f169ad66640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1678070290 0x7f16780726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.005+0000 7f1699d64640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f167806a430 0x7f167806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.005+0000 7f169ad66640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1678070290 0x7f16780726b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.005+0000 7f1699d64640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f167806a430 0x7f167806c8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16940a2ec0 tx=0x7f1690008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.006+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== osd.1 v2:172.21.15.6:6816/89549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1678072d60 con 0x7f1678070290 2023-12-19T15:14:17.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.018+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 --> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f169406d780 con 0x7f1678070290 2023-12-19T15:14:17.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.018+0000 7f168affd640 1 -- 172.21.15.6:0/1828922551 <== osd.1 v2:172.21.15.6:6816/89549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f168c00b4a0 con 0x7f1678070290 2023-12-19T15:14:17.018 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:17.019 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.018+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1678070290 msgr2=0x7f16780726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.018+0000 7f169c7c9640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:6816/89549,v1:172.21.15.6:6817/89549] conn(0x7f1678070290 0x7f16780726b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.018+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f167806a430 msgr2=0x7f167806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.018+0000 7f169c7c9640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f167806a430 0x7f167806c8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16940a2ec0 tx=0x7f1690008040 comp rx=0 tx=0).stop 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1694071240 msgr2=0x7f169414b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169c7c9640 1 --2- 172.21.15.6:0/1828922551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1694071240 0x7f169414b740 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f168400c430 tx=0x7f168400c8f0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169ad66640 1 -- 172.21.15.6:0/1828922551 reap_dead start 2023-12-19T15:14:17.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 shutdown_connections 2023-12-19T15:14:17.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 >> 172.21.15.6:0/1828922551 conn(0x7f169406ae10 msgr2=0x7f16941d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 shutdown_connections 2023-12-19T15:14:17.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.019+0000 7f169c7c9640 1 -- 172.21.15.6:0/1828922551 wait complete. 2023-12-19T15:14:17.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T15:14:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.136+0000 7fd59d84c640 1 Processor -- start 2023-12-19T15:14:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.136+0000 7fd59d84c640 1 -- start start 2023-12-19T15:14:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd59d84c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd598144dd0 0x7fd59814e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd59d84c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5980b7fb0 0x7fd5980b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd59d84c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59814ef70 con 0x7fd59814e670 2023-12-19T15:14:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd59d84c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5980b9a20 con 0x7fd598144dd0 2023-12-19T15:14:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd59d84c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980b6d30 con 0x7fd5980b7fb0 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd598144dd0 0x7fd59814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd598144dd0 0x7fd59814e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55020/0 (socket says 172.21.15.6:55020) 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 -- 172.21.15.6:0/3794604014 learned_addr learned my addr 172.21.15.6:0/3794604014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd5967fc640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5980b7fb0 0x7fd5980b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 -- 172.21.15.6:0/3794604014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5980b7fb0 msgr2=0x7fd5980b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5980b7fb0 0x7fd5980b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 -- 172.21.15.6:0/3794604014 >> v1:172.21.15.89:6789/0 conn(0x7fd59814e670 legacy=0x7fd59814ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd596ffd640 1 -- 172.21.15.6:0/3794604014 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980bca70 con 0x7fd598144dd0 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.137+0000 7fd5967fc640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5980b7fb0 0x7fd5980b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.138+0000 7fd596ffd640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598144dd0 0x7fd59814e130 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd588009870 tx=0x7fd58802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d40a2e4481cb92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.138+0000 7fd595ffb640 1 -- 172.21.15.6:0/3794604014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58802f840 con 0x7fd598144dd0 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.138+0000 7fd595ffb640 1 -- 172.21.15.6:0/3794604014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58802f9a0 con 0x7fd598144dd0 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.138+0000 7fd595ffb640 1 -- 172.21.15.6:0/3794604014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58802fd30 con 0x7fd598144dd0 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 -- 172.21.15.6:0/3794604014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598144dd0 msgr2=0x7fd59814e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598144dd0 0x7fd59814e130 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd588009870 tx=0x7fd58802ba20 comp rx=0 tx=0).stop 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 -- 172.21.15.6:0/3794604014 shutdown_connections 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5980b7fb0 0x7fd5980b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 --2- 172.21.15.6:0/3794604014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598144dd0 0x7fd59814e130 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 -- 172.21.15.6:0/3794604014 >> 172.21.15.6:0/3794604014 conn(0x7fd5980c03d0 msgr2=0x7fd5980c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 -- 172.21.15.6:0/3794604014 shutdown_connections 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.139+0000 7fd59d84c640 1 -- 172.21.15.6:0/3794604014 wait complete. 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.140+0000 7fd59d84c640 1 Processor -- start 2023-12-19T15:14:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.140+0000 7fd59d84c640 1 -- start start 2023-12-19T15:14:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 0x7fd598149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd598144dd0 0x7fd598143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59814e670 0x7fd598144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598146c10 con 0x7fd5980b7fb0 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981e42c0 con 0x7fd59814e670 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981445d0 con 0x7fd598144dd0 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 0x7fd598149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 0x7fd598149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55030/0 (socket says 172.21.15.6:55030) 2023-12-19T15:14:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 -- 172.21.15.6:0/621434161 learned_addr learned my addr 172.21.15.6:0/621434161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd5967fc640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd598144dd0 0x7fd598143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd5977fe640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59814e670 0x7fd598144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 -- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd598144dd0 msgr2=0x7fd598143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd598144dd0 0x7fd598143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 -- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59814e670 msgr2=0x7fd598144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59814e670 0x7fd598144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 -- 172.21.15.6:0/621434161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880094d0 con 0x7fd5980b7fb0 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd596ffd640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 0x7fd598149820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd58802ba60 tx=0x7fd5880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58803b040 con 0x7fd5980b7fb0 2023-12-19T15:14:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588037c40 con 0x7fd5980b7fb0 2023-12-19T15:14:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59814b190 con 0x7fd5980b7fb0 2023-12-19T15:14:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588041400 con 0x7fd5980b7fb0 2023-12-19T15:14:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.141+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd598149430 con 0x7fd5980b7fb0 2023-12-19T15:14:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.142+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd598149620 con 0x7fd5980b7fb0 2023-12-19T15:14:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.143+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd588041560 con 0x7fd5980b7fb0 2023-12-19T15:14:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.143+0000 7fd58ffff640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd57806a460 0x7fd57806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.143+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd5880ab340 con 0x7fd5980b7fb0 2023-12-19T15:14:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.144+0000 7fd5967fc640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd57806a460 0x7fd57806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.144+0000 7fd5967fc640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd57806a460 0x7fd57806c920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd5980bfe90 tx=0x7fd580008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.148+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd588076cc0 con 0x7fd5980b7fb0 2023-12-19T15:14:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.323+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5980b77d0 con 0x7fd57806a460 2023-12-19T15:14:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.324+0000 7fd58ffff640 1 -- 172.21.15.6:0/621434161 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd580015440 con 0x7fd57806a460 2023-12-19T15:14:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T15:14:17.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd57806a460 msgr2=0x7fd57806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd57806a460 0x7fd57806c920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd5980bfe90 tx=0x7fd580008040 comp rx=0 tx=0).stop 2023-12-19T15:14:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 msgr2=0x7fd598149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 0x7fd598149820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd58802ba60 tx=0x7fd5880046c0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 shutdown_connections 2023-12-19T15:14:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd57806a460 0x7fd57806c920 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd59814e670 0x7fd598144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd598144dd0 0x7fd598143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 --2- 172.21.15.6:0/621434161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980b7fb0 0x7fd598149820 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 >> 172.21.15.6:0/621434161 conn(0x7fd5980c03d0 msgr2=0x7fd5980bb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 shutdown_connections 2023-12-19T15:14:17.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.326+0000 7fd59d84c640 1 -- 172.21.15.6:0/621434161 wait complete. 2023-12-19T15:14:17.337 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T15:14:17.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:17.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.447+0000 7f4bab0b6640 1 Processor -- start 2023-12-19T15:14:17.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.447+0000 7f4bab0b6640 1 -- start start 2023-12-19T15:14:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.447+0000 7f4bab0b6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ba4071170 0x7f4ba414b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.447+0000 7f4bab0b6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba41453c0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.447+0000 7f4bab0b6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba414bb50 con 0x7f4ba406ae10 2023-12-19T15:14:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.447+0000 7f4bab0b6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba40b82b0 con 0x7f4ba4071170 2023-12-19T15:14:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba8e52640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ba4071170 0x7f4ba414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ba40b8b50 0x7f4ba40b7ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51988/0 (socket says 172.21.15.6:51988) 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba8e52640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ba4071170 0x7f4ba414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55038/0 (socket says 172.21.15.6:55038) 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba3fff640 1 -- 172.21.15.6:0/3154563022 learned_addr learned my addr 172.21.15.6:0/3154563022 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba8e52640 1 -- 172.21.15.6:0/3154563022 >> v1:172.21.15.89:6789/0 conn(0x7f4ba406ae10 legacy=0x7f4ba41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba8e52640 1 -- 172.21.15.6:0/3154563022 >> v1:172.21.15.6:6789/0 conn(0x7f4ba40b8b50 legacy=0x7f4ba40b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba37fe640 1 -- 172.21.15.6:0/3154563022 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401199264 0 0) 0x7f4ba41453c0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.448+0000 7f4ba8e52640 1 -- 172.21.15.6:0/3154563022 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba406b880 con 0x7f4ba4071170 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.449+0000 7f4ba8e52640 1 --2- 172.21.15.6:0/3154563022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba4071170 0x7f4ba414b610 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b9802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2681d39b10d0269a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.449+0000 7f4ba37fe640 1 -- 172.21.15.6:0/3154563022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98030610 con 0x7f4ba4071170 2023-12-19T15:14:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.449+0000 7f4ba37fe640 1 -- 172.21.15.6:0/3154563022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98030770 con 0x7f4ba4071170 2023-12-19T15:14:17.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.449+0000 7f4ba37fe640 1 -- 172.21.15.6:0/3154563022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98030b00 con 0x7f4ba4071170 2023-12-19T15:14:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3154563022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba4071170 msgr2=0x7f4ba414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 --2- 172.21.15.6:0/3154563022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba4071170 0x7f4ba414b610 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b9802b960 comp rx=0 tx=0).stop 2023-12-19T15:14:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3154563022 shutdown_connections 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 --2- 172.21.15.6:0/3154563022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba4071170 0x7f4ba414b610 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3154563022 >> 172.21.15.6:0/3154563022 conn(0x7f4ba40be1d0 msgr2=0x7f4ba40be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3154563022 shutdown_connections 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.450+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3154563022 wait complete. 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.451+0000 7f4bab0b6640 1 Processor -- start 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.451+0000 7f4bab0b6640 1 -- start start 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba406ae10 0x7f4ba40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ba4071170 0x7f4ba4145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba40b8b50 0x7f4ba4147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40b7040 con 0x7f4ba40b8b50 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4145ab0 con 0x7f4ba406ae10 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba414e570 con 0x7f4ba4071170 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba40b8b50 0x7f4ba4147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba40b8b50 0x7f4ba4147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55046/0 (socket says 172.21.15.6:55046) 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 -- 172.21.15.6:0/3388740178 learned_addr learned my addr 172.21.15.6:0/3388740178 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba3fff640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ba4071170 0x7f4ba4145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba8e52640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba406ae10 0x7f4ba40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 -- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ba4071170 msgr2=0x7f4ba4145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ba4071170 0x7f4ba4145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 -- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba406ae10 msgr2=0x7f4ba40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba406ae10 0x7f4ba40b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 -- 172.21.15.6:0/3388740178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98009400 con 0x7f4ba40b8b50 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba9653640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba40b8b50 0x7f4ba4147d60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c7d0 tx=0x7f4b9c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c003b70 con 0x7f4ba40b8b50 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c003cf0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba414eac0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00aa90 con 0x7f4ba40b8b50 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.452+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba414d4d0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.453+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ba414b0f0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.454+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b9c00abf0 con 0x7f4ba40b8b50 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba17fa640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4b8806a460 0x7f4b8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4b9c088240 con 0x7f4ba40b8b50 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba17fa640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f4b880702c0 0x7f4b880726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 --> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b88072d90 con 0x7f4b880702c0 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b9c08a900 con 0x7f4ba40b8b50 2023-12-19T15:14:17.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba8e52640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4b8806a460 0x7f4b8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba3fff640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f4b880702c0 0x7f4b880726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba3fff640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f4b880702c0 0x7f4b880726e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.455+0000 7f4ba8e52640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4b8806a460 0x7f4b8806c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b98036000 tx=0x7f4b98008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.456+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== osd.2 v2:172.21.15.6:6800/89547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4b88072d90 con 0x7f4b880702c0 2023-12-19T15:14:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.468+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 --> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ba414ae10 con 0x7f4b880702c0 2023-12-19T15:14:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4ba17fa640 1 -- 172.21.15.6:0/3388740178 <== osd.2 v2:172.21.15.6:6800/89547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4b900047e0 con 0x7f4b880702c0 2023-12-19T15:14:17.469 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:17.469 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:17.469 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f4b880702c0 msgr2=0x7f4b880726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:6800/89547,v1:172.21.15.6:6801/89547] conn(0x7f4b880702c0 0x7f4b880726e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4b8806a460 msgr2=0x7f4b8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f4b8806a460 0x7f4b8806c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b98036000 tx=0x7f4b98008030 comp rx=0 tx=0).stop 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba40b8b50 msgr2=0x7f4ba4147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 --2- 172.21.15.6:0/3388740178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba40b8b50 0x7f4ba4147d60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c7d0 tx=0x7f4b9c00cc90 comp rx=0 tx=0).stop 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4ba9653640 1 -- 172.21.15.6:0/3388740178 reap_dead start 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 shutdown_connections 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 >> 172.21.15.6:0/3388740178 conn(0x7f4ba40be1d0 msgr2=0x7f4ba4144750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 shutdown_connections 2023-12-19T15:14:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.469+0000 7f4bab0b6640 1 -- 172.21.15.6:0/3388740178 wait complete. 2023-12-19T15:14:17.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T15:14:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.589+0000 7fd9284b6640 1 Processor -- start 2023-12-19T15:14:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.589+0000 7fd9284b6640 1 -- start start 2023-12-19T15:14:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd9284b6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9200b2e80 0x7fd9200b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd9284b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b7fb0 0x7fd920152130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd9284b6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9200b3ed0 con 0x7fd9200b8df0 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd9284b6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9200b91d0 con 0x7fd9200b2e80 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd9284b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd920142030 con 0x7fd9200b7fb0 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd925a51640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9200b2e80 0x7fd9200b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd926252640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9200b8df0 0x7fd92014ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51990/0 (socket says 172.21.15.6:51990) 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd926252640 1 -- 172.21.15.6:0/4072454543 learned_addr learned my addr 172.21.15.6:0/4072454543 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd926a53640 1 --2- 172.21.15.6:0/4072454543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b7fb0 0x7fd920152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd925a51640 1 -- 172.21.15.6:0/4072454543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b7fb0 msgr2=0x7fd920152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:17.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd925a51640 1 --2- 172.21.15.6:0/4072454543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b7fb0 0x7fd920152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd925a51640 1 -- 172.21.15.6:0/4072454543 >> v1:172.21.15.6:6789/0 conn(0x7fd9200b8df0 legacy=0x7fd92014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.590+0000 7fd925a51640 1 -- 172.21.15.6:0/4072454543 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9200b27f0 con 0x7fd9200b2e80 2023-12-19T15:14:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.591+0000 7fd925a51640 1 --2- 172.21.15.6:0/4072454543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b2e80 0x7fd9200b7a70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097a0 tx=0x7fd91002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2d0ccf52949318 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.591+0000 7fd925250640 1 -- 172.21.15.6:0/4072454543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910030610 con 0x7fd9200b2e80 2023-12-19T15:14:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.591+0000 7fd925250640 1 -- 172.21.15.6:0/4072454543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910030770 con 0x7fd9200b2e80 2023-12-19T15:14:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.591+0000 7fd925250640 1 -- 172.21.15.6:0/4072454543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910030b00 con 0x7fd9200b2e80 2023-12-19T15:14:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.591+0000 7fd9284b6640 1 -- 172.21.15.6:0/4072454543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b2e80 msgr2=0x7fd9200b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.591+0000 7fd9284b6640 1 --2- 172.21.15.6:0/4072454543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b2e80 0x7fd9200b7a70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097a0 tx=0x7fd91002b960 comp rx=0 tx=0).stop 2023-12-19T15:14:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.592+0000 7fd9284b6640 1 -- 172.21.15.6:0/4072454543 shutdown_connections 2023-12-19T15:14:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.592+0000 7fd9284b6640 1 --2- 172.21.15.6:0/4072454543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b7fb0 0x7fd920152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.592+0000 7fd9284b6640 1 --2- 172.21.15.6:0/4072454543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b2e80 0x7fd9200b7a70 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.592+0000 7fd9284b6640 1 -- 172.21.15.6:0/4072454543 >> 172.21.15.6:0/4072454543 conn(0x7fd92006ae10 msgr2=0x7fd92006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.592+0000 7fd9284b6640 1 -- 172.21.15.6:0/4072454543 shutdown_connections 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.592+0000 7fd9284b6640 1 -- 172.21.15.6:0/4072454543 wait complete. 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 Processor -- start 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 -- start start 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b2e80 0x7fd92014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 0x7fd92009d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9200b8df0 0x7fd92009d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92014af90 con 0x7fd9200b7fb0 2023-12-19T15:14:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92009ed20 con 0x7fd9200b8df0 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.593+0000 7fd9284b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92009f950 con 0x7fd9200b2e80 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 0x7fd92009d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 0x7fd92009d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55062/0 (socket says 172.21.15.6:55062) 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 -- 172.21.15.6:0/3338284524 learned_addr learned my addr 172.21.15.6:0/3338284524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd926a53640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9200b8df0 0x7fd92009d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd926252640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b2e80 0x7fd92014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 -- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b2e80 msgr2=0x7fd92014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b2e80 0x7fd92014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 -- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9200b8df0 msgr2=0x7fd92009d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9200b8df0 0x7fd92009d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 -- 172.21.15.6:0/3338284524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009400 con 0x7fd9200b7fb0 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd925a51640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 0x7fd92009d050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd91002bf70 tx=0x7fd910004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91003e040 con 0x7fd9200b7fb0 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910039cb0 con 0x7fd9200b7fb0 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9200a3210 con 0x7fd9200b7fb0 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910044630 con 0x7fd9200b7fb0 2023-12-19T15:14:17.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.594+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92009f340 con 0x7fd9200b7fb0 2023-12-19T15:14:17.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.596+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd91004d3b0 con 0x7fd9200b7fb0 2023-12-19T15:14:17.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.596+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92014b4d0 con 0x7fd9200b7fb0 2023-12-19T15:14:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.596+0000 7fd916ffd640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd90406a430 0x7fd90406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.596+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd9100aab80 con 0x7fd9200b7fb0 2023-12-19T15:14:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.596+0000 7fd926252640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd90406a430 0x7fd90406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.597+0000 7fd926252640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd90406a430 0x7fd90406c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd91c005880 tx=0x7fd91c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.600+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd910076640 con 0x7fd9200b7fb0 2023-12-19T15:14:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.797+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9200b35a0 con 0x7fd90406a430 2023-12-19T15:14:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.798+0000 7fd916ffd640 1 -- 172.21.15.6:0/3338284524 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd91c0014e0 con 0x7fd90406a430 2023-12-19T15:14:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T15:14:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd90406a430 msgr2=0x7fd90406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd90406a430 0x7fd90406c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd91c005880 tx=0x7fd91c009040 comp rx=0 tx=0).stop 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 msgr2=0x7fd92009d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 0x7fd92009d050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd91002bf70 tx=0x7fd910004730 comp rx=0 tx=0).stop 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 shutdown_connections 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd90406a430 0x7fd90406c8f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9200b8df0 0x7fd92009d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9200b7fb0 0x7fd92009d050 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 --2- 172.21.15.6:0/3338284524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9200b2e80 0x7fd92014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 >> 172.21.15.6:0/3338284524 conn(0x7fd92006ae10 msgr2=0x7fd92013ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 shutdown_connections 2023-12-19T15:14:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.800+0000 7fd9284b6640 1 -- 172.21.15.6:0/3338284524 wait complete. 2023-12-19T15:14:17.811 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T15:14:17.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.921+0000 7fe5455ce640 1 Processor -- start 2023-12-19T15:14:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.921+0000 7fe5455ce640 1 -- start start 2023-12-19T15:14:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe5455ce640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe54014aa00 0x7fe5400bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe5455ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe540140ef0 0x7fe540141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe5455ce640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5401418c0 con 0x7fe5400b79f0 2023-12-19T15:14:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe5455ce640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400bbca0 con 0x7fe540140ef0 2023-12-19T15:14:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe5455ce640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400bacc0 con 0x7fe54014aa00 2023-12-19T15:14:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe53f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe540140ef0 0x7fe540141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe53f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe540140ef0 0x7fe540141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55070/0 (socket says 172.21.15.6:55070) 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.922+0000 7fe53f7fe640 1 -- 172.21.15.6:0/940773899 learned_addr learned my addr 172.21.15.6:0/940773899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53e7fc640 1 --2- 172.21.15.6:0/940773899 >> v2:172.21.15.89:3300/0 conn(0x7fe54014aa00 0x7fe5400bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53f7fe640 1 -- 172.21.15.6:0/940773899 >> v2:172.21.15.89:3300/0 conn(0x7fe54014aa00 msgr2=0x7fe5400bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53f7fe640 1 --2- 172.21.15.6:0/940773899 >> v2:172.21.15.89:3300/0 conn(0x7fe54014aa00 0x7fe5400bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53f7fe640 1 -- 172.21.15.6:0/940773899 >> v1:172.21.15.89:6789/0 conn(0x7fe5400b79f0 legacy=0x7fe5400b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53f7fe640 1 -- 172.21.15.6:0/940773899 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400bbe60 con 0x7fe540140ef0 2023-12-19T15:14:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53e7fc640 1 --2- 172.21.15.6:0/940773899 >> v2:172.21.15.89:3300/0 conn(0x7fe54014aa00 0x7fe5400bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53f7fe640 1 --2- 172.21.15.6:0/940773899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540141380 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b80b0 tx=0x7fe53802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638c02fd6c02443 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.923+0000 7fe53dffb640 1 -- 172.21.15.6:0/940773899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53802cb20 con 0x7fe540140ef0 2023-12-19T15:14:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe53dffb640 1 -- 172.21.15.6:0/940773899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53802cc80 con 0x7fe540140ef0 2023-12-19T15:14:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe53dffb640 1 -- 172.21.15.6:0/940773899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380343f0 con 0x7fe540140ef0 2023-12-19T15:14:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 -- 172.21.15.6:0/940773899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 msgr2=0x7fe540141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 --2- 172.21.15.6:0/940773899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540141380 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b80b0 tx=0x7fe53802bf80 comp rx=0 tx=0).stop 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 -- 172.21.15.6:0/940773899 shutdown_connections 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 --2- 172.21.15.6:0/940773899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540141380 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 --2- 172.21.15.6:0/940773899 >> v2:172.21.15.89:3300/0 conn(0x7fe54014aa00 0x7fe5400bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 -- 172.21.15.6:0/940773899 >> 172.21.15.6:0/940773899 conn(0x7fe5400c0340 msgr2=0x7fe5400c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 -- 172.21.15.6:0/940773899 shutdown_connections 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.924+0000 7fe5455ce640 1 -- 172.21.15.6:0/940773899 wait complete. 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.926+0000 7fe5455ce640 1 Processor -- start 2023-12-19T15:14:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.926+0000 7fe5455ce640 1 -- start start 2023-12-19T15:14:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe5455ce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5400b79f0 0x7fe5400bf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe5455ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe5455ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54014aa00 0x7fe540139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe5455ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe540146fe0 con 0x7fe540140ef0 2023-12-19T15:14:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe5455ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400bfda0 con 0x7fe54014aa00 2023-12-19T15:14:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe5455ce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5401482b0 con 0x7fe5400b79f0 2023-12-19T15:14:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55086/0 (socket says 172.21.15.6:55086) 2023-12-19T15:14:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 -- 172.21.15.6:0/3720500000 learned_addr learned my addr 172.21.15.6:0/3720500000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53f7fe640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54014aa00 0x7fe540139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53effd640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5400b79f0 0x7fe5400bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 -- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5400b79f0 msgr2=0x7fe5400bf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5400b79f0 0x7fe5400bf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 -- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54014aa00 msgr2=0x7fe540139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.927+0000 7fe53e7fc640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54014aa00 0x7fe540139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe53e7fc640 1 -- 172.21.15.6:0/3720500000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538009b30 con 0x7fe540140ef0 2023-12-19T15:14:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe53effd640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5400b79f0 0x7fe5400bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe53f7fe640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54014aa00 0x7fe540139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe53e7fc640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540145c90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c820 tx=0x7fe53000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530007a30 con 0x7fe540140ef0 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530007b90 con 0x7fe540140ef0 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5401461d0 con 0x7fe540140ef0 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ce10 con 0x7fe540140ef0 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.928+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe540145490 con 0x7fe540140ef0 2023-12-19T15:14:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.929+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5400baf60 con 0x7fe540140ef0 2023-12-19T15:14:17.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.930+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5300113f0 con 0x7fe540140ef0 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.930+0000 7fe5277fe640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe52c06a430 0x7fe52c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.930+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe530088800 con 0x7fe540140ef0 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.930+0000 7fe5277fe640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7fe52c070290 0x7fe52c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.930+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 --> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe52c072d60 con 0x7fe52c070290 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.930+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe53008ade0 con 0x7fe540140ef0 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.931+0000 7fe53effd640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe52c06a430 0x7fe52c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.931+0000 7fe53f7fe640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7fe52c070290 0x7fe52c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.931+0000 7fe53f7fe640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7fe52c070290 0x7fe52c0726b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.931+0000 7fe53effd640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe52c06a430 0x7fe52c06c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe534003eb0 tx=0x7fe534009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:17.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.932+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== osd.3 v2:172.21.15.6:6821/89558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe52c072d60 con 0x7fe52c070290 2023-12-19T15:14:17.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.944+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 --> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe5400b8bc0 con 0x7fe52c070290 2023-12-19T15:14:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.944+0000 7fe5277fe640 1 -- 172.21.15.6:0/3720500000 <== osd.3 v2:172.21.15.6:6821/89558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe53803e400 con 0x7fe52c070290 2023-12-19T15:14:17.945 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:17.945 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:17.945 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7fe52c070290 msgr2=0x7fe52c0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:6821/89558,v1:172.21.15.6:6823/89558] conn(0x7fe52c070290 0x7fe52c0726b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe52c06a430 msgr2=0x7fe52c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe52c06a430 0x7fe52c06c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe534003eb0 tx=0x7fe534009040 comp rx=0 tx=0).stop 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 msgr2=0x7fe540145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 --2- 172.21.15.6:0/3720500000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe540140ef0 0x7fe540145c90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c820 tx=0x7fe53000cce0 comp rx=0 tx=0).stop 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe53f7fe640 1 -- 172.21.15.6:0/3720500000 reap_dead start 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 shutdown_connections 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 >> 172.21.15.6:0/3720500000 conn(0x7fe5400c0340 msgr2=0x7fe54013fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 shutdown_connections 2023-12-19T15:14:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:17.945+0000 7fe5455ce640 1 -- 172.21.15.6:0/3720500000 wait complete. 2023-12-19T15:14:17.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T15:14:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.062+0000 7f94f6f9f640 1 Processor -- start 2023-12-19T15:14:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.062+0000 7f94f6f9f640 1 -- start start 2023-12-19T15:14:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f6f9f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f00a0cc0 0x7f94f00b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f6f9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94f0148a50 0x7f94f00b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f6f9f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f01498f0 con 0x7f94f0142f20 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f6f9f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f00b37e0 con 0x7f94f0148a50 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f6f9f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f0148fc0 con 0x7f94f00a0cc0 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f553c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94f0148a50 0x7f94f00b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f4d3b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f94f0142f20 0x7f94f00b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51992/0 (socket says 172.21.15.6:51992) 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f4d3b640 1 -- 172.21.15.6:0/1098800595 learned_addr learned my addr 172.21.15.6:0/1098800595 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94effff640 1 --2- 172.21.15.6:0/1098800595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f00a0cc0 0x7f94f00b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f553c640 1 -- 172.21.15.6:0/1098800595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f00a0cc0 msgr2=0x7f94f00b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.063+0000 7f94f553c640 1 --2- 172.21.15.6:0/1098800595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f00a0cc0 0x7f94f00b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.064+0000 7f94f553c640 1 -- 172.21.15.6:0/1098800595 >> v1:172.21.15.6:6789/0 conn(0x7f94f0142f20 legacy=0x7f94f00b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.064+0000 7f94f553c640 1 -- 172.21.15.6:0/1098800595 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f01492a0 con 0x7f94f0148a50 2023-12-19T15:14:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.064+0000 7f94f553c640 1 --2- 172.21.15.6:0/1098800595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f00b92e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009d90 tx=0x7f94e802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bfeef0b8c37a3f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.064+0000 7f94ef7fe640 1 -- 172.21.15.6:0/1098800595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e802cce0 con 0x7f94f0148a50 2023-12-19T15:14:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.064+0000 7f94ef7fe640 1 -- 172.21.15.6:0/1098800595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e802ce40 con 0x7f94f0148a50 2023-12-19T15:14:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.064+0000 7f94ef7fe640 1 -- 172.21.15.6:0/1098800595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8034660 con 0x7f94f0148a50 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 -- 172.21.15.6:0/1098800595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 msgr2=0x7f94f00b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/1098800595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f00b92e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009d90 tx=0x7f94e802bf30 comp rx=0 tx=0).stop 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 -- 172.21.15.6:0/1098800595 shutdown_connections 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/1098800595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f00b92e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/1098800595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f00a0cc0 0x7f94f00b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 -- 172.21.15.6:0/1098800595 >> 172.21.15.6:0/1098800595 conn(0x7f94f00be1e0 msgr2=0x7f94f00be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 -- 172.21.15.6:0/1098800595 shutdown_connections 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.065+0000 7f94f6f9f640 1 -- 172.21.15.6:0/1098800595 wait complete. 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.066+0000 7f94f6f9f640 1 Processor -- start 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.066+0000 7f94f6f9f640 1 -- start start 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f6f9f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f00a0cc0 0x7f94f00bd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f6f9f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f0142f20 0x7f94f00a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f6f9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f01e1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f6f9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00bdd60 con 0x7f94f0148a50 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f6f9f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00a1680 con 0x7f94f00a0cc0 2023-12-19T15:14:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f6f9f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f013d1c0 con 0x7f94f0142f20 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f01e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f01e1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55096/0 (socket says 172.21.15.6:55096) 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 -- 172.21.15.6:0/743573201 learned_addr learned my addr 172.21.15.6:0/743573201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94effff640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f0142f20 0x7f94f00a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f4d3b640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f00a0cc0 0x7f94f00bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 -- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f0142f20 msgr2=0x7f94f00a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f0142f20 0x7f94f00a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 -- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f00a0cc0 msgr2=0x7f94f00bd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f00a0cc0 0x7f94f00bd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f553c640 1 -- 172.21.15.6:0/743573201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8009a70 con 0x7f94f0148a50 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94effff640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f0142f20 0x7f94f00a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.067+0000 7f94f4d3b640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f00a0cc0 0x7f94f00bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.068+0000 7f94f553c640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f01e1070 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f94e8037040 tx=0x7f94e8004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.068+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e803d600 con 0x7f94f0148a50 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.068+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e803d760 con 0x7f94f0148a50 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.068+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f013da60 con 0x7f94f0148a50 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.068+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e803db10 con 0x7f94f0148a50 2023-12-19T15:14:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.068+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f00a2350 con 0x7f94f0148a50 2023-12-19T15:14:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.069+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f0066e90 con 0x7f94f0148a50 2023-12-19T15:14:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.070+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94e803b040 con 0x7f94f0148a50 2023-12-19T15:14:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.070+0000 7f94ed7fa640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f94d406a430 0x7f94d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.070+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f94e80aa9b0 con 0x7f94f0148a50 2023-12-19T15:14:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.070+0000 7f94f4d3b640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f94d406a430 0x7f94d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.071+0000 7f94f4d3b640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f94d406a430 0x7f94d406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f94e4005880 tx=0x7f94e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.078+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f94e8076360 con 0x7f94f0148a50 2023-12-19T15:14:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.266+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f94f0149580 con 0x7f94d406a430 2023-12-19T15:14:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.267+0000 7f94ed7fa640 1 -- 172.21.15.6:0/743573201 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94e4001400 con 0x7f94d406a430 2023-12-19T15:14:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T15:14:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f94d406a430 msgr2=0x7f94d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f94d406a430 0x7f94d406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f94e4005880 tx=0x7f94e4009040 comp rx=0 tx=0).stop 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 msgr2=0x7f94f01e1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f01e1070 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f94e8037040 tx=0x7f94e8004a90 comp rx=0 tx=0).stop 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 shutdown_connections 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f94d406a430 0x7f94d406c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94f0148a50 0x7f94f01e1070 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94f0142f20 0x7f94f00a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 --2- 172.21.15.6:0/743573201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f00a0cc0 0x7f94f00bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 >> 172.21.15.6:0/743573201 conn(0x7f94f00be1e0 msgr2=0x7f94f00b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 shutdown_connections 2023-12-19T15:14:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.269+0000 7f94f6f9f640 1 -- 172.21.15.6:0/743573201 wait complete. 2023-12-19T15:14:18.280 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T15:14:18.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.390+0000 7f4950fe3640 1 Processor -- start 2023-12-19T15:14:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.390+0000 7f4950fe3640 1 -- start start 2023-12-19T15:14:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4950fe3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 0x7f494c0b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4950fe3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c0b81a0 0x7f494c162280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4950fe3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c071960 con 0x7f494c06ef00 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4950fe3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c0b68b0 con 0x7f494c0b81a0 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4950fe3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0709b0 con 0x7f494c0b7410 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 0x7f494c0b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 0x7f494c0b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:38210/0 (socket says 172.21.15.6:38210) 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f4949d9b640 1 -- 172.21.15.6:0/1390544566 learned_addr learned my addr 172.21.15.6:0/1390544566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.392+0000 7f494959a640 1 -- 172.21.15.6:0/1390544566 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836788518 0 0) 0x7f494c071960 con 0x7f494c06ef00 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.391+0000 7f494ad9d640 1 --2- 172.21.15.6:0/1390544566 >> v2:172.21.15.89:3300/0 conn(0x7f494c0b81a0 0x7f494c162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.418+0000 7f494959a640 1 -- 172.21.15.6:0/1390544566 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4934003500 con 0x7f494c06ef00 2023-12-19T15:14:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.419+0000 7f4949d9b640 1 -- 172.21.15.6:0/1390544566 >> v2:172.21.15.89:3300/0 conn(0x7f494c0b81a0 msgr2=0x7f494c162280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:18.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.419+0000 7f4949d9b640 1 --2- 172.21.15.6:0/1390544566 >> v2:172.21.15.89:3300/0 conn(0x7f494c0b81a0 0x7f494c162280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.419+0000 7f4949d9b640 1 -- 172.21.15.6:0/1390544566 >> v1:172.21.15.89:6789/0 conn(0x7f494c06ef00 legacy=0x7f494c0b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.419+0000 7f4949d9b640 1 -- 172.21.15.6:0/1390544566 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0716f0 con 0x7f494c0b7410 2023-12-19T15:14:18.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.419+0000 7f494ad9d640 1 --2- 172.21.15.6:0/1390544566 >> v2:172.21.15.89:3300/0 conn(0x7f494c0b81a0 0x7f494c162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4949d9b640 1 --2- 172.21.15.6:0/1390544566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 0x7f494c0b7c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f494000b970 tx=0x7f494002c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a564d8a66a1fedb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f494959a640 1 -- 172.21.15.6:0/1390544566 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494002ce40 con 0x7f494c0b7410 2023-12-19T15:14:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f494959a640 1 -- 172.21.15.6:0/1390544566 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4940030070 con 0x7f494c0b7410 2023-12-19T15:14:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f494959a640 1 -- 172.21.15.6:0/1390544566 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940036600 con 0x7f494c0b7410 2023-12-19T15:14:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 -- 172.21.15.6:0/1390544566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 msgr2=0x7f494c0b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 --2- 172.21.15.6:0/1390544566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 0x7f494c0b7c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f494000b970 tx=0x7f494002c0f0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 -- 172.21.15.6:0/1390544566 shutdown_connections 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 --2- 172.21.15.6:0/1390544566 >> v2:172.21.15.89:3300/0 conn(0x7f494c0b81a0 0x7f494c162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 --2- 172.21.15.6:0/1390544566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b7410 0x7f494c0b7c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 -- 172.21.15.6:0/1390544566 >> 172.21.15.6:0/1390544566 conn(0x7f494c0b89d0 msgr2=0x7f494c0b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 -- 172.21.15.6:0/1390544566 shutdown_connections 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.420+0000 7f4950fe3640 1 -- 172.21.15.6:0/1390544566 wait complete. 2023-12-19T15:14:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 Processor -- start 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 -- start start 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c06ef00 0x7f494c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f494c0b7410 0x7f494c1ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b81a0 0x7f494c088790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1560f0 con 0x7f494c0b7410 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0b9d10 con 0x7f494c06ef00 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4950fe3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1ed720 con 0x7f494c0b81a0 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f494c0b7410 0x7f494c1ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f494c0b7410 0x7f494c1ed1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55106/0 (socket says 172.21.15.6:55106) 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.422+0000 7f4949d9b640 1 -- 172.21.15.6:0/3188804525 learned_addr learned my addr 172.21.15.6:0/3188804525 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f494ad9d640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b81a0 0x7f494c088790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f494a59c640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c06ef00 0x7f494c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4949d9b640 1 -- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b81a0 msgr2=0x7f494c088790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4949d9b640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b81a0 0x7f494c088790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4949d9b640 1 -- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c06ef00 msgr2=0x7f494c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4949d9b640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c06ef00 0x7f494c155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4949d9b640 1 -- 172.21.15.6:0/3188804525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944007730 con 0x7f494c0b7410 2023-12-19T15:14:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f494ad9d640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494c0b81a0 0x7f494c088790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4949d9b640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f494c0b7410 0x7f494c1ed1e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4940000c00 tx=0x7f49400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940041880 con 0x7f494c0b7410 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49400419e0 con 0x7f494c0b7410 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494000b5d0 con 0x7f494c0b7410 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940041d90 con 0x7f494c0b7410 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.423+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c0b9f60 con 0x7f494c0b7410 2023-12-19T15:14:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.424+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f494c0b8630 con 0x7f494c0b7410 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f494003f440 con 0x7f494c0b7410 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f493affd640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f492c06a430 0x7f492c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f49400abae0 con 0x7f494c0b7410 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f493affd640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f492c070290 0x7f492c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 --> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f492c072d60 con 0x7f492c070290 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49400abf30 con 0x7f494c0b7410 2023-12-19T15:14:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.425+0000 7f494a59c640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f492c06a430 0x7f492c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.426+0000 7f494ad9d640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f492c070290 0x7f492c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.426+0000 7f494a59c640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f492c06a430 0x7f492c06c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f493c007fd0 tx=0x7f493c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.426+0000 7f494ad9d640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f492c070290 0x7f492c0726b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.427+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== osd.4 v2:172.21.15.89:6824/89538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f492c072d60 con 0x7f492c070290 2023-12-19T15:14:18.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.439+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 --> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f494c070150 con 0x7f492c070290 2023-12-19T15:14:18.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f493affd640 1 -- 172.21.15.6:0/3188804525 <== osd.4 v2:172.21.15.89:6824/89538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4944003990 con 0x7f492c070290 2023-12-19T15:14:18.441 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:18.441 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:18.441 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:18.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f492c070290 msgr2=0x7f492c0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6824/89538,v1:172.21.15.89:6825/89538] conn(0x7f492c070290 0x7f492c0726b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f492c06a430 msgr2=0x7f492c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f492c06a430 0x7f492c06c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f493c007fd0 tx=0x7f493c009040 comp rx=0 tx=0).stop 2023-12-19T15:14:18.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f494c0b7410 msgr2=0x7f494c1ed1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 --2- 172.21.15.6:0/3188804525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f494c0b7410 0x7f494c1ed1e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4940000c00 tx=0x7f49400046c0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f494ad9d640 1 -- 172.21.15.6:0/3188804525 reap_dead start 2023-12-19T15:14:18.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 shutdown_connections 2023-12-19T15:14:18.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 >> 172.21.15.6:0/3188804525 conn(0x7f494c0b89d0 msgr2=0x7f494c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 shutdown_connections 2023-12-19T15:14:18.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.440+0000 7f4950fe3640 1 -- 172.21.15.6:0/3188804525 wait complete. 2023-12-19T15:14:18.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T15:14:18.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.558+0000 7f12a2573640 1 Processor -- start 2023-12-19T15:14:18.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.558+0000 7f12a2573640 1 -- start start 2023-12-19T15:14:18.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.558+0000 7f12a2573640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0b94b0 0x7f129c154290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.558+0000 7f12a2573640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c1498f0 con 0x7f129c0a0cc0 2023-12-19T15:14:18.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.558+0000 7f12a2573640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c148fc0 con 0x7f129c142f20 2023-12-19T15:14:18.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.558+0000 7f12a2573640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0b37e0 con 0x7f129c0b94b0 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f129c0a0cc0 0x7f129c0b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52002/0 (socket says 172.21.15.6:52002) 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129b7fe640 1 -- 172.21.15.6:0/112519217 learned_addr learned my addr 172.21.15.6:0/112519217 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f12a0b10640 1 --2- 172.21.15.6:0/112519217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0b94b0 0x7f129c154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708569266 0 0) 0x7f129c1498f0 con 0x7f129c0a0cc0 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1284003520 con 0x7f129c0a0cc0 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507695737 0 0) 0x7f129c148fc0 con 0x7f129c142f20 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f129c1498f0 con 0x7f129c142f20 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1861418736 0 0) 0x7f1284003520 con 0x7f129c0a0cc0 2023-12-19T15:14:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f12a0b10640 1 -- 172.21.15.6:0/112519217 >> v1:172.21.15.89:6789/0 conn(0x7f129c142f20 legacy=0x7f129c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f12a0b10640 1 -- 172.21.15.6:0/112519217 >> v1:172.21.15.6:6789/0 conn(0x7f129c0a0cc0 legacy=0x7f129c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.559+0000 7f12a0b10640 1 -- 172.21.15.6:0/112519217 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c1492a0 con 0x7f129c0b94b0 2023-12-19T15:14:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.560+0000 7f12a0b10640 1 --2- 172.21.15.6:0/112519217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0b94b0 0x7f129c154290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1294009dc0 tx=0x7f129402be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598a79e13e670221 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.560+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290001670 con 0x7f129c0b94b0 2023-12-19T15:14:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.560+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129402c9a0 con 0x7f129c0b94b0 2023-12-19T15:14:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.560+0000 7f129affd640 1 -- 172.21.15.6:0/112519217 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129402cd30 con 0x7f129c0b94b0 2023-12-19T15:14:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 -- 172.21.15.6:0/112519217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0b94b0 msgr2=0x7f129c154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 --2- 172.21.15.6:0/112519217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0b94b0 0x7f129c154290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1294009dc0 tx=0x7f129402be70 comp rx=0 tx=0).stop 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 -- 172.21.15.6:0/112519217 shutdown_connections 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 --2- 172.21.15.6:0/112519217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0b94b0 0x7f129c154290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 -- 172.21.15.6:0/112519217 >> 172.21.15.6:0/112519217 conn(0x7f129c0be1e0 msgr2=0x7f129c0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 -- 172.21.15.6:0/112519217 shutdown_connections 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.561+0000 7f12a2573640 1 -- 172.21.15.6:0/112519217 wait complete. 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.562+0000 7f12a2573640 1 Processor -- start 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.562+0000 7f12a2573640 1 -- start start 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.562+0000 7f12a2573640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0a0cc0 0x7f129c0a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 0x7f129c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c142f20 0x7f129c1e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0a2a30 con 0x7f129c0b94b0 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c14cc30 con 0x7f129c0a0cc0 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c14bf20 con 0x7f129c142f20 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 0x7f129c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 0x7f129c14a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55116/0 (socket says 172.21.15.6:55116) 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 -- 172.21.15.6:0/985292423 learned_addr learned my addr 172.21.15.6:0/985292423 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a0b10640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c142f20 0x7f129c1e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129bfff640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0a0cc0 0x7f129c0a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 -- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c142f20 msgr2=0x7f129c1e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c142f20 0x7f129c1e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 -- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0a0cc0 msgr2=0x7f129c0a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0a0cc0 0x7f129c0a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 -- 172.21.15.6:0/985292423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294009a70 con 0x7f129c0b94b0 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f129b7fe640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 0x7f129c14a470 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f129000c750 tx=0x7f129000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290005ad0 con 0x7f129c0b94b0 2023-12-19T15:14:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290005c30 con 0x7f129c0b94b0 2023-12-19T15:14:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c14c750 con 0x7f129c0b94b0 2023-12-19T15:14:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290007070 con 0x7f129c0b94b0 2023-12-19T15:14:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.563+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c138c30 con 0x7f129c0b94b0 2023-12-19T15:14:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.565+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c066e90 con 0x7f129c0b94b0 2023-12-19T15:14:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.565+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12900071d0 con 0x7f129c0b94b0 2023-12-19T15:14:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.565+0000 7f1298ff9640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f128806a430 0x7f128806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.566+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f12900882c0 con 0x7f129c0b94b0 2023-12-19T15:14:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.566+0000 7f129bfff640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f128806a430 0x7f128806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.566+0000 7f129bfff640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f128806a430 0x7f128806c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f128c0011e0 tx=0x7f128c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.570+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1290053ba0 con 0x7f129c0b94b0 2023-12-19T15:14:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.744+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f129c149580 con 0x7f128806a430 2023-12-19T15:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.745+0000 7f1298ff9640 1 -- 172.21.15.6:0/985292423 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f128c007c60 con 0x7f128806a430 2023-12-19T15:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T15:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f128806a430 msgr2=0x7f128806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f128806a430 0x7f128806c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f128c0011e0 tx=0x7f128c009040 comp rx=0 tx=0).stop 2023-12-19T15:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 msgr2=0x7f129c14a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 0x7f129c14a470 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f129000c750 tx=0x7f129000cc10 comp rx=0 tx=0).stop 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 shutdown_connections 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f128806a430 0x7f128806c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c142f20 0x7f129c1e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f129c0b94b0 0x7f129c14a470 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 --2- 172.21.15.6:0/985292423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0a0cc0 0x7f129c0a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 >> 172.21.15.6:0/985292423 conn(0x7f129c0be1e0 msgr2=0x7f129c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 shutdown_connections 2023-12-19T15:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.747+0000 7f12a2573640 1 -- 172.21.15.6:0/985292423 wait complete. 2023-12-19T15:14:18.758 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T15:14:18.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.869+0000 7fb3f7fd3640 1 Processor -- start 2023-12-19T15:14:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.869+0000 7fb3f7fd3640 1 -- start start 2023-12-19T15:14:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f7fd3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f006a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f7fd3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3f0069d00 0x7fb3f0153320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f7fd3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f0143240 con 0x7fb3f00b9680 2023-12-19T15:14:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f7fd3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f00708c0 con 0x7fb3f0069d00 2023-12-19T15:14:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f7fd3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006fd70 con 0x7fb3f00a2d30 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3f0069d00 0x7fb3f0153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3f0069d00 0x7fb3f0153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55120/0 (socket says 172.21.15.6:55120) 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 -- 172.21.15.6:0/645749059 learned_addr learned my addr 172.21.15.6:0/645749059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f5d6f640 1 --2- 172.21.15.6:0/645749059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 -- 172.21.15.6:0/645749059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 msgr2=0x7fb3f006a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 --2- 172.21.15.6:0/645749059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f006a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 -- 172.21.15.6:0/645749059 >> v1:172.21.15.89:6789/0 conn(0x7fb3f00b9680 legacy=0x7fb3f0148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.870+0000 7fb3f6570640 1 -- 172.21.15.6:0/645749059 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0070580 con 0x7fb3f0069d00 2023-12-19T15:14:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.871+0000 7fb3f6570640 1 --2- 172.21.15.6:0/645749059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f0069d00 0x7fb3f0153320 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009870 tx=0x7fb3e802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38411efe95afee11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.871+0000 7fb3f4d6d640 1 -- 172.21.15.6:0/645749059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8030840 con 0x7fb3f0069d00 2023-12-19T15:14:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.871+0000 7fb3f4d6d640 1 -- 172.21.15.6:0/645749059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e80309a0 con 0x7fb3f0069d00 2023-12-19T15:14:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.871+0000 7fb3f4d6d640 1 -- 172.21.15.6:0/645749059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8030d30 con 0x7fb3f0069d00 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/645749059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f0069d00 msgr2=0x7fb3f0153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 --2- 172.21.15.6:0/645749059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f0069d00 0x7fb3f0153320 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009870 tx=0x7fb3e802b980 comp rx=0 tx=0).stop 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/645749059 shutdown_connections 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 --2- 172.21.15.6:0/645749059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f0069d00 0x7fb3f0153320 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 --2- 172.21.15.6:0/645749059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f006a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/645749059 >> 172.21.15.6:0/645749059 conn(0x7fb3f006ae10 msgr2=0x7fb3f006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/645749059 shutdown_connections 2023-12-19T15:14:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.872+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/645749059 wait complete. 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 Processor -- start 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 -- start start 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3f0069d00 0x7fb3f0147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f0149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f00b9680 0x7fb3f014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f01480f0 con 0x7fb3f00b9680 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f014be80 con 0x7fb3f0069d00 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.873+0000 7fb3f7fd3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0148970 con 0x7fb3f00a2d30 2023-12-19T15:14:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f00b9680 0x7fb3f014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f00b9680 0x7fb3f014c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55136/0 (socket says 172.21.15.6:55136) 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 -- 172.21.15.6:0/4257142866 learned_addr learned my addr 172.21.15.6:0/4257142866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f556e640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f0149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f5d6f640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3f0069d00 0x7fb3f0147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 -- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 msgr2=0x7fb3f0149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3f00a2d30 0x7fb3f0149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 -- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3f0069d00 msgr2=0x7fb3f0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3f0069d00 0x7fb3f0147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 -- 172.21.15.6:0/4257142866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80094d0 con 0x7fb3f00b9680 2023-12-19T15:14:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f6570640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f00b9680 0x7fb3f014c2f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb3e802b9c0 tx=0x7fb3e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8039d50 con 0x7fb3f00b9680 2023-12-19T15:14:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8043400 con 0x7fb3f00b9680 2023-12-19T15:14:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f0144ec0 con 0x7fb3f00b9680 2023-12-19T15:14:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80437b0 con 0x7fb3f00b9680 2023-12-19T15:14:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.874+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f0145750 con 0x7fb3f00b9680 2023-12-19T15:14:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.875+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3f00702a0 con 0x7fb3f00b9680 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.876+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3e8043910 con 0x7fb3f00b9680 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3e67fc640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb3d406a460 0x7fb3d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb3e803e070 con 0x7fb3f00b9680 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3e67fc640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fb3d40702c0 0x7fb3d40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 --> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3d4072d90 con 0x7fb3d40702c0 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3e80ac310 con 0x7fb3f00b9680 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3f5d6f640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb3d406a460 0x7fb3d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3f556e640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fb3d40702c0 0x7fb3d40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.877+0000 7fb3f5d6f640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb3d406a460 0x7fb3d406c920 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec003b80 tx=0x7fb3ec0098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.878+0000 7fb3f556e640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fb3d40702c0 0x7fb3d40726e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.878+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== osd.5 v2:172.21.15.89:6800/89536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb3d4072d90 con 0x7fb3d40702c0 2023-12-19T15:14:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 --> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3f006ffc0 con 0x7fb3d40702c0 2023-12-19T15:14:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3e67fc640 1 -- 172.21.15.6:0/4257142866 <== osd.5 v2:172.21.15.89:6800/89536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb3e0001400 con 0x7fb3d40702c0 2023-12-19T15:14:18.891 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:18.892 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fb3d40702c0 msgr2=0x7fb3d40726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6800/89536,v1:172.21.15.89:6801/89536] conn(0x7fb3d40702c0 0x7fb3d40726e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb3d406a460 msgr2=0x7fb3d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fb3d406a460 0x7fb3d406c920 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec003b80 tx=0x7fb3ec0098d0 comp rx=0 tx=0).stop 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f00b9680 msgr2=0x7fb3f014c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 --2- 172.21.15.6:0/4257142866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f00b9680 0x7fb3f014c2f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb3e802b9c0 tx=0x7fb3e8004730 comp rx=0 tx=0).stop 2023-12-19T15:14:18.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f6570640 1 -- 172.21.15.6:0/4257142866 reap_dead start 2023-12-19T15:14:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 shutdown_connections 2023-12-19T15:14:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.891+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 >> 172.21.15.6:0/4257142866 conn(0x7fb3f006ae10 msgr2=0x7fb3f0149440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.892+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 shutdown_connections 2023-12-19T15:14:18.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:18.892+0000 7fb3f7fd3640 1 -- 172.21.15.6:0/4257142866 wait complete. 2023-12-19T15:14:18.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T15:14:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.010+0000 7f86dbc30640 1 Processor -- start 2023-12-19T15:14:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.010+0000 7f86dbc30640 1 -- start start 2023-12-19T15:14:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86dbc30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d40b8cf0 0x7f86d41478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86dbc30640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d406c960 con 0x7f86d4141e10 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86dbc30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d406cbb0 con 0x7f86d4147e30 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86dbc30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d406ce90 con 0x7f86d40b8cf0 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86da1cd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f86d4141e10 0x7f86d41521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52018/0 (socket says 172.21.15.6:52018) 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86da1cd640 1 -- 172.21.15.6:0/4259471870 learned_addr learned my addr 172.21.15.6:0/4259471870 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d99cc640 1 --2- 172.21.15.6:0/4259471870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d40b8cf0 0x7f86d41478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503153995 0 0) 0x7f86d406c960 con 0x7f86d4141e10 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c0003520 con 0x7f86d4141e10 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413176415 0 0) 0x7f86d406cbb0 con 0x7f86d4147e30 2023-12-19T15:14:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d406c960 con 0x7f86d4147e30 2023-12-19T15:14:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d99cc640 1 -- 172.21.15.6:0/4259471870 >> v1:172.21.15.89:6789/0 conn(0x7f86d4147e30 legacy=0x7f86d4141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d99cc640 1 -- 172.21.15.6:0/4259471870 >> v1:172.21.15.6:6789/0 conn(0x7f86d4141e10 legacy=0x7f86d41521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.011+0000 7f86d99cc640 1 -- 172.21.15.6:0/4259471870 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d406d170 con 0x7f86d40b8cf0 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.012+0000 7f86d99cc640 1 --2- 172.21.15.6:0/4259471870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d40b8cf0 0x7f86d41478f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86d00097d0 tx=0x7f86d002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1063421a8784fd9f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.012+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0030880 con 0x7f86d40b8cf0 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.012+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d00309e0 con 0x7f86d40b8cf0 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.012+0000 7f86d89ca640 1 -- 172.21.15.6:0/4259471870 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0030d50 con 0x7f86d40b8cf0 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 -- 172.21.15.6:0/4259471870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d40b8cf0 msgr2=0x7f86d41478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 --2- 172.21.15.6:0/4259471870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d40b8cf0 0x7f86d41478f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86d00097d0 tx=0x7f86d002b9c0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 -- 172.21.15.6:0/4259471870 shutdown_connections 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 --2- 172.21.15.6:0/4259471870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d40b8cf0 0x7f86d41478f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 -- 172.21.15.6:0/4259471870 >> 172.21.15.6:0/4259471870 conn(0x7f86d406ae10 msgr2=0x7f86d406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 -- 172.21.15.6:0/4259471870 shutdown_connections 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.013+0000 7f86dbc30640 1 -- 172.21.15.6:0/4259471870 wait complete. 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.014+0000 7f86dbc30640 1 Processor -- start 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.014+0000 7f86dbc30640 1 -- start start 2023-12-19T15:14:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.014+0000 7f86dbc30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d40b8cf0 0x7f86d4140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.014+0000 7f86dbc30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d4141e10 0x7f86d413c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86dbc30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 0x7f86d413cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86dbc30640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4140860 con 0x7f86d4147e30 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86dbc30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d41431b0 con 0x7f86d40b8cf0 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86dbc30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d41de2e0 con 0x7f86d4141e10 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 0x7f86d413cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 0x7f86d413cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55138/0 (socket says 172.21.15.6:55138) 2023-12-19T15:14:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 -- 172.21.15.6:0/3103574984 learned_addr learned my addr 172.21.15.6:0/3103574984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86d99cc640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d40b8cf0 0x7f86d4140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86d91cb640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d4141e10 0x7f86d413c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 -- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d4141e10 msgr2=0x7f86d413c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d4141e10 0x7f86d413c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 -- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d40b8cf0 msgr2=0x7f86d4140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d40b8cf0 0x7f86d4140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 -- 172.21.15.6:0/3103574984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0009400 con 0x7f86d4147e30 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86da1cd640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 0x7f86d413cac0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00cbd0 tx=0x7f86cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc00ace0 con 0x7f86d4147e30 2023-12-19T15:14:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc00ae40 con 0x7f86d4147e30 2023-12-19T15:14:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d41de5c0 con 0x7f86d4147e30 2023-12-19T15:14:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc012620 con 0x7f86d4147e30 2023-12-19T15:14:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.015+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d413c060 con 0x7f86d4147e30 2023-12-19T15:14:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.016+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d413c280 con 0x7f86d4147e30 2023-12-19T15:14:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.017+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86cc007070 con 0x7f86d4147e30 2023-12-19T15:14:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.018+0000 7f86ca7fc640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86b806a430 0x7f86b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.018+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86cc0887a0 con 0x7f86d4147e30 2023-12-19T15:14:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.018+0000 7f86d99cc640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86b806a430 0x7f86b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.018+0000 7f86d99cc640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86b806a430 0x7f86b806c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f86d0036000 tx=0x7f86d0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.022+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86cc054150 con 0x7f86d4147e30 2023-12-19T15:14:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.200+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f86d40b90d0 con 0x7f86b806a430 2023-12-19T15:14:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.201+0000 7f86ca7fc640 1 -- 172.21.15.6:0/3103574984 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86d0030b50 con 0x7f86b806a430 2023-12-19T15:14:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T15:14:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86b806a430 msgr2=0x7f86b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86b806a430 0x7f86b806c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f86d0036000 tx=0x7f86d0008030 comp rx=0 tx=0).stop 2023-12-19T15:14:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 msgr2=0x7f86d413cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 0x7f86d413cac0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00cbd0 tx=0x7f86cc00a430 comp rx=0 tx=0).stop 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 shutdown_connections 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f86b806a430 0x7f86b806c8f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d4147e30 0x7f86d413cac0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86d4141e10 0x7f86d413c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 --2- 172.21.15.6:0/3103574984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86d40b8cf0 0x7f86d4140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 >> 172.21.15.6:0/3103574984 conn(0x7f86d406ae10 msgr2=0x7f86d4070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 shutdown_connections 2023-12-19T15:14:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.203+0000 7f86dbc30640 1 -- 172.21.15.6:0/3103574984 wait complete. 2023-12-19T15:14:19.214 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T15:14:19.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:19.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.324+0000 7f7305f48640 1 Processor -- start 2023-12-19T15:14:19.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.324+0000 7f7305f48640 1 -- start start 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.324+0000 7f7305f48640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f73000ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.324+0000 7f7305f48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7300146480 con 0x7f73000baaf0 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.324+0000 7f7305f48640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730009bc70 con 0x7f73001460a0 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.324+0000 7f7305f48640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73000bc080 con 0x7f73000bb200 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f73000baaf0 0x7f7300153270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52020/0 (socket says 172.21.15.6:52020) 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fffff640 1 -- 172.21.15.6:0/4084272773 learned_addr learned my addr 172.21.15.6:0/4084272773 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72feffd640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f73000ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793621228 0 0) 0x7f7300146480 con 0x7f73000baaf0 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e8003520 con 0x7f73000baaf0 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509522614 0 0) 0x7f72e8003520 con 0x7f73000baaf0 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 msgr2=0x7f73000ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f73000ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 >> v1:172.21.15.89:6789/0 conn(0x7f73001460a0 legacy=0x7f73000bb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000b8470 con 0x7f73000baaf0 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7f72f80019f0 con 0x7f73000baaf0 2023-12-19T15:14:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 >> v1:172.21.15.6:6789/0 conn(0x7f73000baaf0 legacy=0x7f7300153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f72e80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e8003f20 0x7f72e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f72e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000bc080 con 0x7f72e8004d00 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800baf0 con 0x7f72e8003f20 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800bcb0 con 0x7f73000bb200 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72ff7fe640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f72e80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72fffff640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f72e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.325+0000 7f72feffd640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e8003f20 0x7f72e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fffff640 1 -- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 msgr2=0x7f72e80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fffff640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f72e80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fffff640 1 -- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e8003f20 msgr2=0x7f72e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fffff640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e8003f20 0x7f72e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fffff640 1 -- 172.21.15.6:0/4084272773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8003520 con 0x7f72e8004d00 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72ff7fe640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73000bb200 0x7f72e80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fffff640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f72e8005180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f72f800a820 tx=0x7f72e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450e077a23e2e4b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.326+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80072d0 con 0x7f72e8004d00 2023-12-19T15:14:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.327+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f802f070 con 0x7f72e8004d00 2023-12-19T15:14:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.327+0000 7f72fe7fc640 1 -- 172.21.15.6:0/4084272773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007690 con 0x7f72e8004d00 2023-12-19T15:14:19.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f7305f48640 1 -- 172.21.15.6:0/4084272773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 msgr2=0x7f72e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f7305f48640 1 --2- 172.21.15.6:0/4084272773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f72e8005180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f72f800a820 tx=0x7f72e80057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f72fffff640 1 -- 172.21.15.6:0/4084272773 reap_dead start 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f7305f48640 1 -- 172.21.15.6:0/4084272773 shutdown_connections 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f7305f48640 1 -- 172.21.15.6:0/4084272773 >> 172.21.15.6:0/4084272773 conn(0x7f73000b9250 msgr2=0x7f73000b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f7305f48640 1 -- 172.21.15.6:0/4084272773 shutdown_connections 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.328+0000 7f7305f48640 1 -- 172.21.15.6:0/4084272773 wait complete. 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.329+0000 7f7305f48640 1 Processor -- start 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.329+0000 7f7305f48640 1 -- start start 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.329+0000 7f7305f48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f7300070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.329+0000 7f7305f48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7300071170 0x7f73001e07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.329+0000 7f7305f48640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73001e0d00 0x7f73001e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f7305f48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000702a0 con 0x7f72e8004d00 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f7305f48640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001e0330 con 0x7f7300071170 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f7305f48640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73000b1bb0 con 0x7f73001e0d00 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f7300070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f7300070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55168/0 (socket says 172.21.15.6:55168) 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 -- 172.21.15.6:0/1186797224 learned_addr learned my addr 172.21.15.6:0/1186797224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 -- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73001e0d00 msgr2=0x7f73001e3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72fffff640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73001e0d00 0x7f73001e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72feffd640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7300071170 0x7f73001e07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73001e0d00 0x7f73001e3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 -- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7300071170 msgr2=0x7f73001e07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7300071170 0x7f73001e07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 -- 172.21.15.6:0/1186797224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73001e1180 con 0x7f72e8004d00 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72fffff640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73001e0d00 0x7f73001e3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72feffd640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7300071170 0x7f73001e07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72ff7fe640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f7300070c30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f72f000f960 tx=0x7f72f000fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f00052e0 con 0x7f72e8004d00 2023-12-19T15:14:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0005440 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000da30 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73000b1e10 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.330+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73000704a0 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.331+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73000b8710 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72f000db90 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72e7fff640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f72ec06a460 0x7f72ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72f0088780 con 0x7f72e8004d00 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72feffd640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f72ec06a460 0x7f72ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72e7fff640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7f72ec0702c0 0x7f72ec0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 --> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72ec072d90 con 0x7f72ec0702c0 2023-12-19T15:14:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72f008ae40 con 0x7f72e8004d00 2023-12-19T15:14:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.332+0000 7f72fffff640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7f72ec0702c0 0x7f72ec0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.333+0000 7f72feffd640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f72ec06a460 0x7f72ec06c920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7300142590 tx=0x7f72f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.333+0000 7f72fffff640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7f72ec0702c0 0x7f72ec0726e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.334+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== osd.6 v2:172.21.15.89:6816/89547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f72ec072d90 con 0x7f72ec0702c0 2023-12-19T15:14:19.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.346+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 --> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f730009bec0 con 0x7f72ec0702c0 2023-12-19T15:14:19.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f72e7fff640 1 -- 172.21.15.6:0/1186797224 <== osd.6 v2:172.21.15.89:6816/89547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f72f8004b60 con 0x7f72ec0702c0 2023-12-19T15:14:19.347 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:19.347 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7f72ec0702c0 msgr2=0x7f72ec0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6816/89547,v1:172.21.15.89:6817/89547] conn(0x7f72ec0702c0 0x7f72ec0726e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f72ec06a460 msgr2=0x7f72ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f72ec06a460 0x7f72ec06c920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7300142590 tx=0x7f72f4008040 comp rx=0 tx=0).stop 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 msgr2=0x7f7300070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 --2- 172.21.15.6:0/1186797224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8004d00 0x7f7300070c30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f72f000f960 tx=0x7f72f000fe20 comp rx=0 tx=0).stop 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f72fffff640 1 -- 172.21.15.6:0/1186797224 reap_dead start 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 shutdown_connections 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 >> 172.21.15.6:0/1186797224 conn(0x7f73000b9250 msgr2=0x7f7300141c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 shutdown_connections 2023-12-19T15:14:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.347+0000 7f7305f48640 1 -- 172.21.15.6:0/1186797224 wait complete. 2023-12-19T15:14:19.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T15:14:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.464+0000 7f395536e640 1 Processor -- start 2023-12-19T15:14:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f395536e640 1 -- start start 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f395536e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3950144dd0 0x7f395014e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f395536e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39500b7fb0 0x7f39500b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f395536e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395014ef70 con 0x7f395014e670 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f395536e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39500b9a20 con 0x7f39500b7fb0 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f395536e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b6d30 con 0x7f3950144dd0 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f394e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39500b7fb0 0x7f39500b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f394e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39500b7fb0 0x7f39500b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55174/0 (socket says 172.21.15.6:55174) 2023-12-19T15:14:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f394f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f395014e670 0x7f395014ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52022/0 (socket says 172.21.15.6:52022) 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f394e7fc640 1 -- 172.21.15.6:0/895885860 learned_addr learned my addr 172.21.15.6:0/895885860 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.465+0000 7f394effd640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3950144dd0 0x7f395014e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394e7fc640 1 -- 172.21.15.6:0/895885860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3950144dd0 msgr2=0x7f395014e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394e7fc640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3950144dd0 0x7f395014e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394e7fc640 1 -- 172.21.15.6:0/895885860 >> v1:172.21.15.6:6789/0 conn(0x7f395014e670 legacy=0x7f395014ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394e7fc640 1 -- 172.21.15.6:0/895885860 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500bca70 con 0x7f39500b7fb0 2023-12-19T15:14:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394effd640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3950144dd0 0x7f395014e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394e7fc640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39500b7fb0 0x7f39500b87b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3940009870 tx=0x7f394002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ce811583c2196b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.466+0000 7f394dffb640 1 -- 172.21.15.6:0/895885860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394002f840 con 0x7f39500b7fb0 2023-12-19T15:14:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f394dffb640 1 -- 172.21.15.6:0/895885860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394002f9a0 con 0x7f39500b7fb0 2023-12-19T15:14:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f394dffb640 1 -- 172.21.15.6:0/895885860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394002fd30 con 0x7f39500b7fb0 2023-12-19T15:14:19.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 -- 172.21.15.6:0/895885860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39500b7fb0 msgr2=0x7f39500b87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39500b7fb0 0x7f39500b87b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3940009870 tx=0x7f394002ba20 comp rx=0 tx=0).stop 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 -- 172.21.15.6:0/895885860 shutdown_connections 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39500b7fb0 0x7f39500b87b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 --2- 172.21.15.6:0/895885860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3950144dd0 0x7f395014e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 -- 172.21.15.6:0/895885860 >> 172.21.15.6:0/895885860 conn(0x7f39500c03d0 msgr2=0x7f39500c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 -- 172.21.15.6:0/895885860 shutdown_connections 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.467+0000 7f395536e640 1 -- 172.21.15.6:0/895885860 wait complete. 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.468+0000 7f395536e640 1 Processor -- start 2023-12-19T15:14:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.468+0000 7f395536e640 1 -- start start 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f395536e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39500b7fb0 0x7f3950146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f395536e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3950144dd0 0x7f39500ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f395536e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 0x7f39500addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f395536e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950146e40 con 0x7f395014e670 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f395536e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500ae300 con 0x7f3950144dd0 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f395536e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39501e3740 con 0x7f39500b7fb0 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 0x7f39500addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 0x7f39500addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55188/0 (socket says 172.21.15.6:55188) 2023-12-19T15:14:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 -- 172.21.15.6:0/2598635768 learned_addr learned my addr 172.21.15.6:0/2598635768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394effd640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39500b7fb0 0x7f3950146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394e7fc640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3950144dd0 0x7f39500ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 -- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39500b7fb0 msgr2=0x7f3950146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39500b7fb0 0x7f3950146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 -- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3950144dd0 msgr2=0x7f39500ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3950144dd0 0x7f39500ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394f7fe640 1 -- 172.21.15.6:0/2598635768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400094d0 con 0x7f395014e670 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394effd640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39500b7fb0 0x7f3950146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.469+0000 7f394e7fc640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3950144dd0 0x7f39500ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.470+0000 7f394f7fe640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 0x7f39500addc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f394800c730 tx=0x7f394800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.470+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800ce40 con 0x7f395014e670 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.470+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394800a640 con 0x7f395014e670 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.470+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39501e3a20 con 0x7f395014e670 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.470+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800a9f0 con 0x7f395014e670 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.470+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39501e3fe0 con 0x7f395014e670 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.471+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3950073a40 con 0x7f395014e670 2023-12-19T15:14:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.471+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f394800ab50 con 0x7f395014e670 2023-12-19T15:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.472+0000 7f39377fe640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f393c06a430 0x7f393c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.472+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3948087c10 con 0x7f395014e670 2023-12-19T15:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.472+0000 7f394effd640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f393c06a430 0x7f393c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.472+0000 7f394effd640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f393c06a430 0x7f393c06c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3944006fd0 tx=0x7f3944008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.476+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39480570d0 con 0x7f395014e670 2023-12-19T15:14:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.651+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f39500b77d0 con 0x7f393c06a430 2023-12-19T15:14:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.652+0000 7f39377fe640 1 -- 172.21.15.6:0/2598635768 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3944009600 con 0x7f393c06a430 2023-12-19T15:14:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T15:14:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f393c06a430 msgr2=0x7f393c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f393c06a430 0x7f393c06c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3944006fd0 tx=0x7f3944008040 comp rx=0 tx=0).stop 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 msgr2=0x7f39500addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 0x7f39500addc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f394800c730 tx=0x7f394800cbf0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 shutdown_connections 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f393c06a430 0x7f393c06c8f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395014e670 0x7f39500addc0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3950144dd0 0x7f39500ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 --2- 172.21.15.6:0/2598635768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39500b7fb0 0x7f3950146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 >> 172.21.15.6:0/2598635768 conn(0x7f39500c03d0 msgr2=0x7f39500bee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 shutdown_connections 2023-12-19T15:14:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.654+0000 7f395536e640 1 -- 172.21.15.6:0/2598635768 wait complete. 2023-12-19T15:14:19.665 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T15:14:19.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T15:14:19.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.778+0000 7f26316bd640 1 Processor -- start 2023-12-19T15:14:19.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.778+0000 7f26316bd640 1 -- start start 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f26316bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c0bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f26316bd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f262c14aa00 0x7f262c0b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f26316bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f262c140ef0 0x7f262c141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f26316bd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0bbca0 con 0x7f262c14aa00 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f26316bd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c1418c0 con 0x7f262c140ef0 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f26316bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0bacc0 con 0x7f262c0b79f0 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f262c14aa00 0x7f262c0b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f262c14aa00 0x7f262c0b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55194/0 (socket says 172.21.15.6:55194) 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 -- 172.21.15.6:0/4270047194 learned_addr learned my addr 172.21.15.6:0/4270047194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262b7fe640 1 --2- 172.21.15.6:0/4270047194 >> v2:172.21.15.89:3300/0 conn(0x7f262c140ef0 0x7f262c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262affd640 1 --2- 172.21.15.6:0/4270047194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c0bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 -- 172.21.15.6:0/4270047194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 msgr2=0x7f262c0bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 --2- 172.21.15.6:0/4270047194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c0bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 -- 172.21.15.6:0/4270047194 >> v2:172.21.15.89:3300/0 conn(0x7f262c140ef0 msgr2=0x7f262c141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 --2- 172.21.15.6:0/4270047194 >> v2:172.21.15.89:3300/0 conn(0x7f262c140ef0 0x7f262c141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.779+0000 7f262a7fc640 1 -- 172.21.15.6:0/4270047194 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0bbe60 con 0x7f262c14aa00 2023-12-19T15:14:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.780+0000 7f262a7fc640 1 --2- 172.21.15.6:0/4270047194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c14aa00 0x7f262c0b83a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f262c145020 tx=0x7f261c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d37ac828f605d7f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.780+0000 7f2629ffb640 1 -- 172.21.15.6:0/4270047194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c030860 con 0x7f262c14aa00 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.780+0000 7f2629ffb640 1 -- 172.21.15.6:0/4270047194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c0309c0 con 0x7f262c14aa00 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.780+0000 7f2629ffb640 1 -- 172.21.15.6:0/4270047194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c030d50 con 0x7f262c14aa00 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 -- 172.21.15.6:0/4270047194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c14aa00 msgr2=0x7f262c0b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 --2- 172.21.15.6:0/4270047194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c14aa00 0x7f262c0b83a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f262c145020 tx=0x7f261c02b9a0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 -- 172.21.15.6:0/4270047194 shutdown_connections 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 --2- 172.21.15.6:0/4270047194 >> v2:172.21.15.89:3300/0 conn(0x7f262c140ef0 0x7f262c141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 --2- 172.21.15.6:0/4270047194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c14aa00 0x7f262c0b83a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 --2- 172.21.15.6:0/4270047194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c0bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 -- 172.21.15.6:0/4270047194 >> 172.21.15.6:0/4270047194 conn(0x7f262c0c0340 msgr2=0x7f262c0c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 -- 172.21.15.6:0/4270047194 shutdown_connections 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.781+0000 7f26316bd640 1 -- 172.21.15.6:0/4270047194 wait complete. 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.782+0000 7f26316bd640 1 Processor -- start 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.782+0000 7f26316bd640 1 -- start start 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c140ef0 0x7f262c14e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c14aa00 0x7f262c0bf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0bfec0 con 0x7f262c140ef0 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c14cc00 con 0x7f262c14aa00 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c14c920 con 0x7f262c0b79f0 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c140ef0 0x7f262c14e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c140ef0 0x7f262c14e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55200/0 (socket says 172.21.15.6:55200) 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 -- 172.21.15.6:0/1643952371 learned_addr learned my addr 172.21.15.6:0/1643952371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262b7fe640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c14aa00 0x7f262c0bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262affd640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 -- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 msgr2=0x7f262c143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0b79f0 0x7f262c143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 -- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c14aa00 msgr2=0x7f262c0bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c14aa00 0x7f262c0bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 -- 172.21.15.6:0/1643952371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0094d0 con 0x7f262c140ef0 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f262a7fc640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c140ef0 0x7f262c14e800 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f261c02b9e0 tx=0x7f261c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c03e070 con 0x7f262c140ef0 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c039990 con 0x7f262c140ef0 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c039d20 con 0x7f262c140ef0 2023-12-19T15:14:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.783+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c14e2e0 con 0x7f262c140ef0 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.784+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c14c630 con 0x7f262c140ef0 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.784+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f262c0baf60 con 0x7f262c140ef0 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.785+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f261c0423f0 con 0x7f262c140ef0 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.785+0000 7f26137fe640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f261806a430 0x7f261806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.785+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f261c0aa340 con 0x7f262c140ef0 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.785+0000 7f26137fe640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f2618070290 0x7f26180726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.785+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 --> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2618072d60 con 0x7f2618070290 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.786+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f261c0ac920 con 0x7f262c140ef0 2023-12-19T15:14:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.786+0000 7f262affd640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f261806a430 0x7f261806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.786+0000 7f262b7fe640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f2618070290 0x7f26180726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.786+0000 7f262affd640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f261806a430 0x7f261806c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2620009ac0 tx=0x7f2620009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.786+0000 7f262b7fe640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f2618070290 0x7f26180726b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.787+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== osd.7 v2:172.21.15.89:6808/89537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2618072d60 con 0x7f2618070290 2023-12-19T15:14:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.799+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 --> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f262c0b8bc0 con 0x7f2618070290 2023-12-19T15:14:19.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26137fe640 1 -- 172.21.15.6:0/1643952371 <== osd.7 v2:172.21.15.89:6808/89537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f262400f040 con 0x7f2618070290 2023-12-19T15:14:19.800 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-12-19T15:14:19.800 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T15:14:19.800 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-12-19T15:14:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f2618070290 msgr2=0x7f26180726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6808/89537,v1:172.21.15.89:6809/89537] conn(0x7f2618070290 0x7f26180726b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f261806a430 msgr2=0x7f261806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f261806a430 0x7f261806c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2620009ac0 tx=0x7f2620009190 comp rx=0 tx=0).stop 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c140ef0 msgr2=0x7f262c14e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 --2- 172.21.15.6:0/1643952371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f262c140ef0 0x7f262c14e800 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f261c02b9e0 tx=0x7f261c0046c0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f262b7fe640 1 -- 172.21.15.6:0/1643952371 reap_dead start 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 shutdown_connections 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 >> 172.21.15.6:0/1643952371 conn(0x7f262c0c0340 msgr2=0x7f262c13d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 shutdown_connections 2023-12-19T15:14:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.800+0000 7f26316bd640 1 -- 172.21.15.6:0/1643952371 wait complete. 2023-12-19T15:14:19.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T15:14:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.918+0000 7fd373e51640 1 Processor -- start 2023-12-19T15:14:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.918+0000 7fd373e51640 1 -- start start 2023-12-19T15:14:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd373e51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd36c142f20 0x7fd36c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd373e51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 0x7fd36c153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd373e51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c1498f0 con 0x7fd36c0a0cc0 2023-12-19T15:14:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd373e51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0b37e0 con 0x7fd36c142f20 2023-12-19T15:14:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd373e51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c148fc0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd3723ee640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 0x7fd36c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.919+0000 7fd371bed640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd36c142f20 0x7fd36c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3713ec640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd36c0a0cc0 0x7fd36c0b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.6:47392/0 (socket says 172.21.15.6:47392) 2023-12-19T15:14:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3723ee640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 0x7fd36c153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.6:38350/0 (socket says 172.21.15.6:38350) 2023-12-19T15:14:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3713ec640 1 -- 172.21.15.6:0/2985091627 learned_addr learned my addr 172.21.15.6:0/2985091627 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3723ee640 1 -- 172.21.15.6:0/2985091627 >> v2:172.21.15.89:3300/0 conn(0x7fd36c142f20 msgr2=0x7fd36c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3723ee640 1 --2- 172.21.15.6:0/2985091627 >> v2:172.21.15.89:3300/0 conn(0x7fd36c142f20 0x7fd36c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3723ee640 1 -- 172.21.15.6:0/2985091627 >> v1:172.21.15.89:6789/0 conn(0x7fd36c0a0cc0 legacy=0x7fd36c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd3723ee640 1 -- 172.21.15.6:0/2985091627 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c1492a0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.920+0000 7fd371bed640 1 --2- 172.21.15.6:0/2985091627 >> v2:172.21.15.89:3300/0 conn(0x7fd36c142f20 0x7fd36c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.921+0000 7fd3723ee640 1 --2- 172.21.15.6:0/2985091627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 0x7fd36c153280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd364009d90 tx=0x7fd36402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf214d05ea1672c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.921+0000 7fd370beb640 1 -- 172.21.15.6:0/2985091627 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36402cce0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.921+0000 7fd370beb640 1 -- 172.21.15.6:0/2985091627 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36402ce40 con 0x7fd36c0b94b0 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.921+0000 7fd370beb640 1 -- 172.21.15.6:0/2985091627 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364034660 con 0x7fd36c0b94b0 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 -- 172.21.15.6:0/2985091627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 msgr2=0x7fd36c153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 --2- 172.21.15.6:0/2985091627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 0x7fd36c153280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd364009d90 tx=0x7fd36402bf30 comp rx=0 tx=0).stop 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 -- 172.21.15.6:0/2985091627 shutdown_connections 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 --2- 172.21.15.6:0/2985091627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c0b94b0 0x7fd36c153280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 --2- 172.21.15.6:0/2985091627 >> v2:172.21.15.89:3300/0 conn(0x7fd36c142f20 0x7fd36c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 -- 172.21.15.6:0/2985091627 >> 172.21.15.6:0/2985091627 conn(0x7fd36c0be1e0 msgr2=0x7fd36c0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 -- 172.21.15.6:0/2985091627 shutdown_connections 2023-12-19T15:14:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.922+0000 7fd373e51640 1 -- 172.21.15.6:0/2985091627 wait complete. 2023-12-19T15:14:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.923+0000 7fd373e51640 1 Processor -- start 2023-12-19T15:14:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.923+0000 7fd373e51640 1 -- start start 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd373e51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36c0a0cc0 0x7fd36c147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd373e51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 0x7fd36c1de380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd373e51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c142f20 0x7fd36c1e1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd373e51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c147f90 con 0x7fd36c0b94b0 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd373e51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c0b5ec0 con 0x7fd36c0a0cc0 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd373e51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1de8c0 con 0x7fd36c142f20 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 0x7fd36c1de380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 0x7fd36c1de380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55212/0 (socket says 172.21.15.6:55212) 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 -- 172.21.15.6:0/2195923233 learned_addr learned my addr 172.21.15.6:0/2195923233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd371bed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36c0a0cc0 0x7fd36c147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3723ee640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c142f20 0x7fd36c1e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 -- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c142f20 msgr2=0x7fd36c1e1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c142f20 0x7fd36c1e1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 -- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36c0a0cc0 msgr2=0x7fd36c147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36c0a0cc0 0x7fd36c147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 -- 172.21.15.6:0/2195923233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009400 con 0x7fd36c0b94b0 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd371bed640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36c0a0cc0 0x7fd36c147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.924+0000 7fd3713ec640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 0x7fd36c1de380 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c530 tx=0x7fd36800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.925+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368005ce0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.925+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd368005e40 con 0x7fd36c0b94b0 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.925+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368007270 con 0x7fd36c0b94b0 2023-12-19T15:14:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.925+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364009a70 con 0x7fd36c0b94b0 2023-12-19T15:14:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.925+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c0b80c0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.926+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c066e90 con 0x7fd36c0b94b0 2023-12-19T15:14:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.926+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3680073d0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.927+0000 7fd35e7fc640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd35006a460 0x7fd35006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.927+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd368087ac0 con 0x7fd36c0b94b0 2023-12-19T15:14:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.927+0000 7fd371bed640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd35006a460 0x7fd35006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.927+0000 7fd371bed640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd35006a460 0x7fd35006c920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd360009fd0 tx=0x7fd360009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:19.931+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3680533c0 con 0x7fd36c0b94b0 2023-12-19T15:14:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.107+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd36c0a3580 con 0x7fd35006a460 2023-12-19T15:14:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.108+0000 7fd35e7fc640 1 -- 172.21.15.6:0/2195923233 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd360004020 con 0x7fd35006a460 2023-12-19T15:14:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T15:14:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd35006a460 msgr2=0x7fd35006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd35006a460 0x7fd35006c920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd360009fd0 tx=0x7fd360009190 comp rx=0 tx=0).stop 2023-12-19T15:14:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 msgr2=0x7fd36c1de380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 0x7fd36c1de380 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c530 tx=0x7fd36800c9f0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 shutdown_connections 2023-12-19T15:14:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd35006a460 0x7fd35006c920 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd36c142f20 0x7fd36c1e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd36c0b94b0 0x7fd36c1de380 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 --2- 172.21.15.6:0/2195923233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36c0a0cc0 0x7fd36c147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 >> 172.21.15.6:0/2195923233 conn(0x7fd36c0be1e0 msgr2=0x7fd36c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 shutdown_connections 2023-12-19T15:14:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.110+0000 7fd373e51640 1 -- 172.21.15.6:0/2195923233 wait complete. 2023-12-19T15:14:20.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T15:14:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.228+0000 7fc00f718640 1 Processor -- start 2023-12-19T15:14:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.228+0000 7fc00f718640 1 -- start start 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00f718640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0080ba3a0 0x7fc00806f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00f718640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc00814ca90 0x7fc00806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00f718640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080ba780 con 0x7fc0080b46e0 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00f718640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00806f900 con 0x7fc00814ca90 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00f718640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00814c600 con 0x7fc0080ba3a0 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00ccb3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc00814ca90 0x7fc00806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00dcb5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc0080b46e0 0x7fc0080b4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52038/0 (socket says 172.21.15.6:52038) 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00ccb3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc00814ca90 0x7fc00806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55224/0 (socket says 172.21.15.6:55224) 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00dcb5640 1 -- 172.21.15.6:0/2232992613 learned_addr learned my addr 172.21.15.6:0/2232992613 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00d4b4640 1 --2- 172.21.15.6:0/2232992613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0080ba3a0 0x7fc00806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00ccb3640 1 -- 172.21.15.6:0/2232992613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0080ba3a0 msgr2=0x7fc00806f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00ccb3640 1 --2- 172.21.15.6:0/2232992613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0080ba3a0 0x7fc00806f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00ccb3640 1 -- 172.21.15.6:0/2232992613 >> v1:172.21.15.6:6789/0 conn(0x7fc0080b46e0 legacy=0x7fc0080b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fc00ccb3640 1 -- 172.21.15.6:0/2232992613 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00814bfb0 con 0x7fc00814ca90 2023-12-19T15:14:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.229+0000 7fbffffff640 1 -- 172.21.15.6:0/2232992613 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592490413 0 0) 0x7fc0080ba780 con 0x7fc0080b46e0 2023-12-19T15:14:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.230+0000 7fc00ccb3640 1 --2- 172.21.15.6:0/2232992613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00814ca90 0x7fc00806d7b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc0040097a0 tx=0x7fc00402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642e34b51a558a53 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.230+0000 7fbffffff640 1 -- 172.21.15.6:0/2232992613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004031830 con 0x7fc00814ca90 2023-12-19T15:14:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.230+0000 7fbffffff640 1 -- 172.21.15.6:0/2232992613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004031990 con 0x7fc00814ca90 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.230+0000 7fbffffff640 1 -- 172.21.15.6:0/2232992613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004031d20 con 0x7fc00814ca90 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 -- 172.21.15.6:0/2232992613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00814ca90 msgr2=0x7fc00806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 --2- 172.21.15.6:0/2232992613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00814ca90 0x7fc00806d7b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc0040097a0 tx=0x7fc00402b8d0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 -- 172.21.15.6:0/2232992613 shutdown_connections 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 --2- 172.21.15.6:0/2232992613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00814ca90 0x7fc00806d7b0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 --2- 172.21.15.6:0/2232992613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0080ba3a0 0x7fc00806f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 -- 172.21.15.6:0/2232992613 >> 172.21.15.6:0/2232992613 conn(0x7fc0080bac30 msgr2=0x7fc0080bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 -- 172.21.15.6:0/2232992613 shutdown_connections 2023-12-19T15:14:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.231+0000 7fc00f718640 1 -- 172.21.15.6:0/2232992613 wait complete. 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.232+0000 7fc00f718640 1 Processor -- start 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.232+0000 7fc00f718640 1 -- start start 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00f718640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 0x7fc0081e0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00f718640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0080ba3a0 0x7fc008145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00f718640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00814ca90 0x7fc00806be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00f718640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008143790 con 0x7fc0080b46e0 2023-12-19T15:14:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00f718640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008143a10 con 0x7fc0080ba3a0 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00f718640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081dfe90 con 0x7fc00814ca90 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 0x7fc0081e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 0x7fc0081e0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55240/0 (socket says 172.21.15.6:55240) 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 -- 172.21.15.6:0/3255063141 learned_addr learned my addr 172.21.15.6:0/3255063141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00dcb5640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00814ca90 0x7fc00806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00ccb3640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0080ba3a0 0x7fc008145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 -- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00814ca90 msgr2=0x7fc00806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00814ca90 0x7fc00806be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 -- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0080ba3a0 msgr2=0x7fc008145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0080ba3a0 0x7fc008145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 -- 172.21.15.6:0/3255063141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004009400 con 0x7fc0080b46e0 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00ccb3640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0080ba3a0 0x7fc008145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fc00d4b4640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 0x7fc0081e0690 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbff800d800 tx=0x7fbff800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.233+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800b6c0 con 0x7fc0080b46e0 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.234+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800b820 con 0x7fc0080b46e0 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.234+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800bbb0 con 0x7fc0080b46e0 2023-12-19T15:14:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.234+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0081e0170 con 0x7fc0080b46e0 2023-12-19T15:14:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.234+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00806cd30 con 0x7fc0080b46e0 2023-12-19T15:14:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.235+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008073a40 con 0x7fc0080b46e0 2023-12-19T15:14:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.235+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbff800bd10 con 0x7fc0080b46e0 2023-12-19T15:14:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.235+0000 7fbffdffb640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfec06a460 0x7fbfec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.236+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbff8088a90 con 0x7fc0080b46e0 2023-12-19T15:14:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.236+0000 7fc00ccb3640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfec06a460 0x7fbfec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.236+0000 7fc00ccb3640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfec06a460 0x7fbfec06c920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc004036000 tx=0x7fc00403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.240+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbff8054410 con 0x7fc0080b46e0 2023-12-19T15:14:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.413+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0080b5260 con 0x7fbfec06a460 2023-12-19T15:14:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.416+0000 7fbffdffb640 1 -- 172.21.15.6:0/3255063141 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50378 (secure 0 0 0) 0x7fc00403a420 con 0x7fbfec06a460 2023-12-19T15:14:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:20.417 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T15:14:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfec06a460 msgr2=0x7fbfec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfec06a460 0x7fbfec06c920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc004036000 tx=0x7fc00403c040 comp rx=0 tx=0).stop 2023-12-19T15:14:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 msgr2=0x7fc0081e0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 0x7fc0081e0690 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbff800d800 tx=0x7fbff800dcc0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 shutdown_connections 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fbfec06a460 0x7fbfec06c920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc00814ca90 0x7fc00806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0080ba3a0 0x7fc008145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 --2- 172.21.15.6:0/3255063141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0080b46e0 0x7fc0081e0690 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 >> 172.21.15.6:0/3255063141 conn(0x7fc0080bac30 msgr2=0x7fc00814a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 shutdown_connections 2023-12-19T15:14:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:20.418+0000 7fc00f718640 1 -- 172.21.15.6:0/3255063141 wait complete. 2023-12-19T15:14:20.429 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":3068,"stamp":"2023-12-19T15:14:19.448596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":7759808,"kb_used_data":4224,"kb_used_omap":1216,"kb_used_meta":7754303,"kb_avail":747214912,"statfs":{"total":773094113280,"available":765148069888,"internally_reserved":0,"allocated":4325376,"data_stored":2393986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1246071,"internal_metadata":7940406409},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":220,"apply_latency_ms":220,"commit_latency_ns":220000000,"apply_latency_ns":220000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753222234,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66314,"num_read_kb":-54112292,"num_write":-2262174,"num_write_kb":-61071554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001806"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T15:14:11.622098+0000","last_change":"2023-12-19T13:32:57.187684+0000","last_active":"2023-12-19T15:14:11.622098+0000","last_peered":"2023-12-19T15:14:11.622098+0000","last_clean":"2023-12-19T15:14:11.622098+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T15:14:11.622098+0000","last_undegraded":"2023-12-19T15:14:11.622098+0000","last_fullsized":"2023-12-19T15:14:11.622098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T13:32:56.115638+0000","last_clean_scrub_stamp":"2023-12-19T13:32:56.115638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:29:44.646799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576062,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008844,"kb_used_data":964,"kb_used_omap":8,"kb_used_meta":1007863,"kb_avail":93362996,"statfs":{"total":96636764160,"available":95603707904,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8659,"internal_metadata":1032052269},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.501,"15min":0.55200000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.9129999999999998,"5min":2.9129999999999998,"15min":23.206},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.27400000000000002},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.60999999999999999,"15min":0.54700000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.60199999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.6720000000000002,"5min":3.6720000000000002,"15min":22.962},"last":0.41299999999999998}]},{"osd":2,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56499999999999995,"15min":0.54500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.315},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.29699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":10.459},"last":0.45800000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.63100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.694,"5min":3.694,"15min":23.106999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.629,"15min":0.65500000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.28399999999999997},"max":{"1min":5.8799999999999999,"5min":5.8799999999999999,"15min":22.995999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.495,"15min":0.60899999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.61199999999999999,"5min":0.80800000000000005,"15min":23.079999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.503,"15min":0.61699999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.84299999999999997,"15min":23.245000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":5.2510000000000003},"last":0.437},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.66300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6469999999999998,"5min":3.6469999999999998,"15min":23.02},"last":0.52600000000000002}]},{"osd":6,"last update":"Tue Dec 19 15:13:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.495},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61599999999999999,"15min":0.69599999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":23.053000000000001},"last":0.50800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834576068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1642120,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1641728,"kb_avail":92729720,"statfs":{"total":96636764160,"available":94955233280,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1681129472},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":7.4489999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49399999999999999,"15min":0.53500000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":5.8579999999999997},"last":0.45100000000000001}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.54500000000000004,"15min":0.67200000000000004},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":6.0010000000000003,"5min":6.0010000000000003,"15min":22.858000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.57399999999999995,"15min":0.66700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":21.678000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":5.4989999999999997,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.308},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.66500000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":21.081},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.32400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":5.1989999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.437}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.63900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":21.175000000000001},"last":0.374},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":5.266},"last":0.50900000000000001}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68799999999999994,"5min":0.77400000000000002,"15min":0.78500000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76800000000000002,"5min":0.84599999999999997,"15min":3.7549999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.66700000000000004},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.27500000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":19.489999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":7.9569999999999999},"last":0.52100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834576064,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":435016,"kb_used_data":384,"kb_used_omap":6,"kb_used_meta":434617,"kb_avail":93936824,"statfs":{"total":96636764160,"available":96191307776,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7151,"internal_metadata":445047825},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":10.920999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":6.4180000000000001,"5min":6.4180000000000001,"15min":6.4180000000000001},"last":0.434}]},{"osd":1,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":19.231000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.129,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.28799999999999998},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.45300000000000001}]},{"osd":2,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.56799999999999995,"15min":0.60999999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.367,"5min":6.367,"15min":9.9290000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.079,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33700000000000002},"max":{"1min":10.906000000000001,"5min":10.906000000000001,"15min":19.166},"last":0.497}]},{"osd":3,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.61899999999999999,"15min":0.66400000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":19.443999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.085,"5min":0.67100000000000004,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.25800000000000001},"max":{"1min":11.797000000000001,"5min":11.797000000000001,"15min":19.207000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27000000000000002},"max":{"1min":8.0850000000000009,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.60299999999999998,"15min":0.58499999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":7.8220000000000001,"5min":7.8220000000000001,"15min":7.8220000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":4.9550000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Dec 19 15:13:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.63,"15min":0.69599999999999995},"min":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.5049999999999999,"5min":6.5049999999999999,"15min":19.268999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":7.7510000000000003,"5min":7.7510000000000003,"15min":7.7510000000000003},"last":0.70799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834576064,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":560328,"kb_used_data":384,"kb_used_omap":9,"kb_used_meta":559926,"kb_avail":93811512,"statfs":{"total":96636764160,"available":96062988288,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9784,"internal_metadata":573364680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.48999999999999999,"15min":0.51500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.80600000000000005,"5min":3.613,"15min":8.8569999999999993},"last":0.373},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46300000000000002,"15min":0.57499999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.49299999999999999,"5min":0.72799999999999998,"15min":12.231999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64600000000000002,"5min":2.1509999999999998,"15min":2.1960000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":2.085,"15min":2.4180000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.495,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":2.3730000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50800000000000001,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":8.8330000000000002},"last":0.44}]},{"osd":3,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54500000000000004,"5min":10.359,"15min":12.275},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.53600000000000003,"15min":0.624},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":9.0269999999999992},"last":0.71299999999999997}]},{"osd":5,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.50800000000000001,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.246},"max":{"1min":0.86399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.48899999999999999,"15min":0.60399999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.749,"15min":12.298},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51700000000000002,"15min":0.61499999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.26600000000000001},"max":{"1min":0.67600000000000005,"5min":0.75600000000000001,"15min":15.207000000000001},"last":0.502},{"interface":"front","average":{"1min":0.497,"5min":0.55300000000000005,"15min":0.626},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":8.7959999999999994},"last":0.63200000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54800000000000004,"15min":0.66300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":18.420999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.782,"15min":15.164999999999999},"last":0.67100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834576064,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":591048,"kb_used_data":384,"kb_used_omap":59,"kb_used_meta":590596,"kb_avail":93780792,"statfs":{"total":96636764160,"available":96031531008,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60700,"internal_metadata":604771044},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.36699999999999999,"15min":0.54300000000000004},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.83999999999999997,"5min":4.1130000000000004,"15min":31.536000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.376,"15min":0.57399999999999995},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.433,"5min":3.2040000000000002,"15min":31.611000000000001},"last":0.35499999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.372,"15min":0.50600000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.65800000000000003,"5min":3.875,"15min":22.16},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.49399999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64700000000000002,"5min":3.1789999999999998,"15min":10.189},"last":0.46400000000000002}]},{"osd":2,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.40400000000000003,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57499999999999996,"5min":3.9780000000000002,"15min":22.777000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41799999999999998,"15min":0.46700000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":3.8340000000000001,"15min":9.4830000000000005},"last":0.377}]},{"osd":4,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.55500000000000005,"15min":0.68200000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72599999999999998,"5min":3.1110000000000002,"15min":13.738},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.58499999999999996,"15min":0.67000000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60099999999999998,"5min":3.9279999999999999,"15min":9.3439999999999994},"last":0.44900000000000001}]},{"osd":5,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.59399999999999997,"15min":0.66900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56399999999999995,"5min":4.0359999999999996,"15min":10.439},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.70299999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74099999999999999,"5min":1.0629999999999999,"15min":10.253},"last":0.40899999999999997}]},{"osd":6,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.621,"15min":0.67600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":4.0730000000000004,"15min":5.585},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.56200000000000006,"15min":0.67200000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77200000000000002,"5min":1.0920000000000001,"15min":9.5180000000000007},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57299999999999995,"15min":0.75800000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":1.1220000000000001,"15min":22.117000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.60399999999999998,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":3.1459999999999999,"15min":9.7390000000000008},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834576066,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1628228,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":1627840,"kb_avail":92743612,"statfs":{"total":96636764160,"available":94969458688,"internally_reserved":0,"allocated":389120,"data_stored":150892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1666908160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.32100000000000001,"15min":0.36699999999999999},"min":{"1min":0.224,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":1.357,"5min":1.357,"15min":5.1779999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.35999999999999999},"min":{"1min":0.251,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":8.5459999999999994},"last":0.33600000000000002}]},{"osd":1,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.39500000000000002},"min":{"1min":0.23999999999999999,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":6.367},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.23300000000000001},"max":{"1min":1.401,"5min":1.401,"15min":5.2859999999999996},"last":0.74399999999999999}]},{"osd":3,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.40799999999999997,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.26900000000000002},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":8.1910000000000007},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.42099999999999999},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27000000000000002},"max":{"1min":1.498,"5min":1.498,"15min":5.3129999999999997},"last":0.436}]},{"osd":4,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.60099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.311},"max":{"1min":1.468,"5min":1.468,"15min":5.2169999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":7.1580000000000004,"5min":7.1580000000000004,"15min":10.959},"last":0.47299999999999998}]},{"osd":5,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.623,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.589,"5min":3.589,"15min":6.407},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58799999999999997,"15min":0.627},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":5.2450000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":7.048,"5min":7.048,"15min":8.4979999999999993},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":11.66},"last":0.45600000000000002}]},{"osd":7,"last update":"Tue Dec 19 15:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.212,"5min":1.212,"15min":8.5239999999999991},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.496,"5min":3.496,"15min":20.228000000000002},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834576064,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":531848,"kb_used_data":384,"kb_used_omap":1132,"kb_used_meta":530323,"kb_avail":93839992,"statfs":{"total":96636764160,"available":96092151808,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159777,"internal_metadata":543051167},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.51600000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":4.306,"5min":4.306,"15min":38.348999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.54300000000000004,"15min":0.76900000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.048,"5min":9.0150000000000006,"15min":73.376000000000005},"last":0.26600000000000001}]},{"osd":2,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.48799999999999999,"15min":0.65300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.186},"max":{"1min":3.0510000000000002,"5min":3.9140000000000001,"15min":68.296000000000006},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61799999999999999,"15min":0.80800000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":1.7070000000000001,"5min":9.0839999999999996,"15min":73.349999999999994},"last":0.33100000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":3.8679999999999999,"15min":8.282},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":1.038},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.3529999999999998,"5min":5.9290000000000003,"15min":72.754999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":18.861000000000001},"last":0.748}]},{"osd":5,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77100000000000002,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.3879999999999999,"5min":5.9560000000000004,"15min":72.823999999999998},"last":0.57799999999999996}]},{"osd":6,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":1.0580000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.35199999999999998},"max":{"1min":4.4180000000000001,"5min":6.008,"15min":72.792000000000002},"last":0.62},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":3.101,"5min":4.1790000000000003,"15min":5.9710000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89800000000000002,"5min":4.0300000000000002,"15min":13.942},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.755},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.5920000000000001,"5min":4.1479999999999997,"15min":22.631},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834576066,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1362376,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":1361408,"kb_avail":93009464,"statfs":{"total":96636764160,"available":95241691136,"internally_reserved":0,"allocated":983040,"data_stored":741260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1394081792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":7.0730000000000004,"5min":7.0730000000000004,"15min":11.076000000000001},"last":0.25},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.875,"5min":1.3819999999999999,"15min":9.5969999999999995},"last":0.36299999999999999}]},{"osd":2,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.51500000000000001,"15min":0.58299999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.1509999999999998,"5min":7.1509999999999998,"15min":30.41},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24399999999999999},"max":{"1min":13.970000000000001,"5min":13.970000000000001,"15min":13.970000000000001},"last":0.316}]},{"osd":3,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.2919999999999998,"5min":9.984,"15min":15.484},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.1299999999999999,"5min":12.144,"15min":12.144},"last":0.33000000000000002}]},{"osd":4,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57999999999999996,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":9.109},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.72199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.125,"5min":2.04,"15min":18.951000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":11.426,"5min":11.426,"15min":11.426},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":12.074999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.1059999999999999,"5min":7.1059999999999999,"15min":9.4429999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":9.6340000000000003},"last":0.434}]},{"osd":7,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":7.3550000000000004,"5min":7.3550000000000004,"15min":12.129},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":7.3540000000000001},"last":0.377}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T15:14:20.433 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T13:32:56.115638+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=13, tm_min=32, tm_sec=56, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=15, tm_min=14, tm_sec=15, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T15:14:20.433 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T15:14:40.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T15:14:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.541+0000 7fd547e41640 1 Processor -- start 2023-12-19T15:14:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.541+0000 7fd547e41640 1 -- start start 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd547e41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 0x7fd54014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd547e41640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54006b820 con 0x7fd54014b020 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd547e41640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54006eac0 con 0x7fd5400ba290 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd547e41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54006de60 con 0x7fd54006d770 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd5463de640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd54014b020 0x7fd540155420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54278/0 (socket says 172.21.15.6:54278) 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd5463de640 1 -- 172.21.15.6:0/834421661 learned_addr learned my addr 172.21.15.6:0/834421661 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd5453dc640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 0x7fd54014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521750580 0 0) 0x7fd54006b820 con 0x7fd54014b020 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd52c003520 con 0x7fd54014b020 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268576934 0 0) 0x7fd52c003520 con 0x7fd54014b020 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 msgr2=0x7fd54014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 0x7fd54014aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 >> v1:172.21.15.89:6789/0 conn(0x7fd5400ba290 legacy=0x7fd54006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54014b4b0 con 0x7fd54014b020 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3881389690 0 0) 0x7fd5380019f0 con 0x7fd54014b020 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 >> v1:172.21.15.6:6789/0 conn(0x7fd54014b020 legacy=0x7fd540155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0039a0 0x7fd52c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 0x7fd52c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd52c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c00b980 con 0x7fd52c004d00 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c00bac0 con 0x7fd52c0039a0 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c00bc80 con 0x7fd54006d770 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd545bdd640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0039a0 0x7fd52c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.542+0000 7fd5463de640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd52c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.543+0000 7fd5453dc640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 0x7fd52c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.543+0000 7fd5463de640 1 -- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 msgr2=0x7fd52c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.543+0000 7fd5463de640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54006d770 0x7fd52c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.543+0000 7fd5463de640 1 -- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0039a0 msgr2=0x7fd52c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.543+0000 7fd5463de640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0039a0 0x7fd52c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.543+0000 7fd5463de640 1 -- 172.21.15.6:0/834421661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c003520 con 0x7fd52c004d00 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd5463de640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd52c005180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd53800a830 tx=0x7fd52c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1a50eeed066199 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53802cea0 con 0x7fd52c004d00 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53802f070 con 0x7fd52c004d00 2023-12-19T15:14:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd544bdb640 1 -- 172.21.15.6:0/834421661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538034890 con 0x7fd52c004d00 2023-12-19T15:14:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd547e41640 1 -- 172.21.15.6:0/834421661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 msgr2=0x7fd52c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd547e41640 1 --2- 172.21.15.6:0/834421661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd52c005180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd53800a830 tx=0x7fd52c0057f0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd5463de640 1 -- 172.21.15.6:0/834421661 reap_dead start 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd547e41640 1 -- 172.21.15.6:0/834421661 shutdown_connections 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd547e41640 1 -- 172.21.15.6:0/834421661 >> 172.21.15.6:0/834421661 conn(0x7fd5400bac30 msgr2=0x7fd5400bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd547e41640 1 -- 172.21.15.6:0/834421661 shutdown_connections 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.544+0000 7fd547e41640 1 -- 172.21.15.6:0/834421661 wait complete. 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.545+0000 7fd547e41640 1 Processor -- start 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.545+0000 7fd547e41640 1 -- start start 2023-12-19T15:14:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd547e41640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd54014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd547e41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54009ecf0 0x7fd54009f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd547e41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54009ce40 0x7fd54009d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd547e41640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54009e860 con 0x7fd52c004d00 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd547e41640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54009f650 con 0x7fd54009ecf0 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd547e41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400b3970 con 0x7fd54009ce40 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd545bdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd54014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd545bdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd54014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58786/0 (socket says 172.21.15.6:58786) 2023-12-19T15:14:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd545bdd640 1 -- 172.21.15.6:0/1063453550 learned_addr learned my addr 172.21.15.6:0/1063453550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd5453dc640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54009ecf0 0x7fd54009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd5463de640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54009ce40 0x7fd54009d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd545bdd640 1 -- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54009ce40 msgr2=0x7fd54009d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.546+0000 7fd545bdd640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54009ce40 0x7fd54009d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd545bdd640 1 -- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54009ecf0 msgr2=0x7fd54009f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd545bdd640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54009ecf0 0x7fd54009f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd545bdd640 1 -- 172.21.15.6:0/1063453550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5401e3980 con 0x7fd52c004d00 2023-12-19T15:14:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd545bdd640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd54014e310 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00f770 tx=0x7fd53c00fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0050d0 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c005250 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00d730 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5401e3c60 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.547+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5400b3c50 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.548+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd540073a40 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.548+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd53c00d890 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.549+0000 7fd5367fc640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd52406a460 0x7fd52406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.549+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd53c088520 con 0x7fd52c004d00 2023-12-19T15:14:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.549+0000 7fd5453dc640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd52406a460 0x7fd52406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.549+0000 7fd5453dc640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd52406a460 0x7fd52406c920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd54009dfb0 tx=0x7fd530009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.553+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd53c053e10 con 0x7fd52c004d00 2023-12-19T15:14:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.729+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 --> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd54006b1d0 con 0x7fd52406a460 2023-12-19T15:14:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.732+0000 7fd5367fc640 1 -- 172.21.15.6:0/1063453550 <== mgr.4108 v2:172.21.15.89:6832/88967 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50069 (secure 0 0 0) 0x7fd530019070 con 0x7fd52406a460 2023-12-19T15:14:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-12-19T15:14:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd52406a460 msgr2=0x7fd52406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd52406a460 0x7fd52406c920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd54009dfb0 tx=0x7fd530009190 comp rx=0 tx=0).stop 2023-12-19T15:14:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 msgr2=0x7fd54014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd54014e310 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00f770 tx=0x7fd53c00fb70 comp rx=0 tx=0).stop 2023-12-19T15:14:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 shutdown_connections 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fd52406a460 0x7fd52406c920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd54009ce40 0x7fd54009d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd54009ecf0 0x7fd54009f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 --2- 172.21.15.6:0/1063453550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52c004d00 0x7fd54014e310 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 >> 172.21.15.6:0/1063453550 conn(0x7fd5400bac30 msgr2=0x7fd5400a2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 shutdown_connections 2023-12-19T15:14:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.734+0000 7fd547e41640 1 -- 172.21.15.6:0/1063453550 wait complete. 2023-12-19T15:14:40.744 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":3078,"stamp":"2023-12-19T15:14:39.453122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":7759808,"kb_used_data":4224,"kb_used_omap":1216,"kb_used_meta":7754303,"kb_avail":747214912,"statfs":{"total":773094113280,"available":765148069888,"internally_reserved":0,"allocated":4325376,"data_stored":2393986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1246071,"internal_metadata":7940406409},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002698"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T15:14:24.043618+0000","last_change":"2023-12-19T15:14:24.043760+0000","last_active":"2023-12-19T15:14:24.043618+0000","last_peered":"2023-12-19T15:14:24.043618+0000","last_clean":"2023-12-19T15:14:24.043618+0000","last_became_active":"2023-12-19T13:32:57.186768+0000","last_became_peered":"2023-12-19T13:32:57.186768+0000","last_unstale":"2023-12-19T15:14:24.043618+0000","last_undegraded":"2023-12-19T15:14:24.043618+0000","last_fullsized":"2023-12-19T15:14:24.043618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2023-12-19T15:14:24.043596+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2023-12-19T15:14:24.043596+0000","last_clean_scrub_stamp":"2023-12-19T15:14:24.043596+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:25.859559+0000","scrub_duration":0.049367131000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576066,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008844,"kb_used_data":964,"kb_used_omap":8,"kb_used_meta":1007863,"kb_avail":93362996,"statfs":{"total":96636764160,"available":95603707904,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8659,"internal_metadata":1032052269},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.31,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":6.202,"5min":6.202,"15min":23.206},"last":0.37},{"interface":"front","average":{"1min":1.3819999999999999,"5min":0.69099999999999995,"15min":0.57499999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":13.220000000000001,"5min":13.220000000000001,"15min":13.220000000000001},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":0.72299999999999998,"15min":0.59399999999999997},"min":{"1min":0.27100000000000002,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":13.164,"5min":13.164,"15min":13.164},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.161,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.309,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":13.038,"5min":13.038,"15min":22.962},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.68600000000000005,"15min":0.59099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33600000000000002},"max":{"1min":13.827999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.52100000000000002,"15min":0.55200000000000005},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":10.459},"last":0.41299999999999998}]},{"osd":3,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.32500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":12.942,"5min":12.942,"15min":23.106999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.1749999999999998,"5min":6.1749999999999998,"15min":22.995999999999999},"last":0.497}]},{"osd":4,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.53100000000000003,"15min":0.61899999999999999},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.1589999999999998,"5min":4.1589999999999998,"15min":23.079999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.28499999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":13.288,"5min":13.288,"15min":23.245000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":0.69099999999999995,"15min":0.627},"min":{"1min":0.309,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":13.124000000000001,"5min":13.124000000000001,"15min":13.124000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.62,"15min":0.67500000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":23.02},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Dec 19 15:14:17 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":0.73399999999999999,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":13.084,"5min":13.084,"15min":13.084},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.1820000000000004,"5min":4.1820000000000004,"15min":23.053000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834576072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1642120,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1641728,"kb_avail":92729720,"statfs":{"total":96636764160,"available":94955233280,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1681129472},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51900000000000002,"15min":0.55200000000000005},"min":{"1min":0.24399999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":7.4489999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.47699999999999998,"15min":0.53300000000000003},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.70199999999999996,"5min":1.3759999999999999,"15min":5.8579999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.53800000000000003,"15min":0.67300000000000004},"min":{"1min":0.25900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.872,"5min":6.0010000000000003,"15min":22.858000000000001},"last":0.5},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.65100000000000002,"15min":0.69299999999999995},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":8.923,"5min":8.923,"15min":21.678000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.54100000000000004,"15min":0.52200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.25,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.55300000000000005,"15min":0.66900000000000004},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.1560000000000001,"5min":3.1560000000000001,"15min":21.081},"last":0.53400000000000003}]},{"osd":3,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":0.72999999999999998,"15min":0.621},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":19.914999999999999,"5min":19.914999999999999,"15min":19.914999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.622,"15min":0.56499999999999995},"min":{"1min":0.33400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":7.2460000000000004,"5min":7.2460000000000004,"15min":7.2460000000000004},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.55100000000000005,"15min":0.64300000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.198,"5min":3.198,"15min":21.175000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":5.266},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.52900000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.62},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.60199999999999998},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.121,"5min":1.121,"15min":3.7549999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.628,"15min":0.67500000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.27500000000000002},"max":{"1min":4.8179999999999996,"5min":4.8179999999999996,"15min":19.489999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.226,"5min":1.226,"15min":7.9569999999999999},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834576068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":435016,"kb_used_data":384,"kb_used_omap":6,"kb_used_meta":434617,"kb_avail":93936824,"statfs":{"total":96636764160,"available":96191307776,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7151,"internal_metadata":445047825},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.54800000000000004,"15min":0.57599999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65200000000000002,"5min":6.0279999999999996,"15min":10.920999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.4710000000000001,"5min":6.4180000000000001,"15min":6.4180000000000001},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.627,"15min":0.623},"min":{"1min":0.34000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":5.8300000000000001,"5min":7.7949999999999999,"15min":19.231000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":5.9770000000000003,"5min":12.347,"15min":12.347},"last":0.626}]},{"osd":2,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.60899999999999999},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2869999999999999,"5min":6.367,"15min":9.9290000000000003},"last":0.496},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71099999999999997,"5min":10.906000000000001,"15min":19.166},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60599999999999998,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.216,"5min":6.4550000000000001,"15min":19.443999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.25800000000000001},"max":{"1min":3.8460000000000001,"5min":11.797000000000001,"15min":19.207000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63500000000000001,"5min":6.165,"15min":6.165},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59899999999999998,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64700000000000002,"5min":7.8220000000000001,"15min":7.8220000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.58099999999999996},"min":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.84299999999999997,"5min":1.3080000000000001,"15min":4.9550000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Tue Dec 19 15:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.624,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72399999999999998,"5min":6.5049999999999999,"15min":19.268999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.34699999999999998},"max":{"1min":0.72199999999999998,"5min":7.7510000000000003,"15min":7.7510000000000003},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834576068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":560328,"kb_used_data":384,"kb_used_omap":9,"kb_used_meta":559926,"kb_avail":93811512,"statfs":{"total":96636764160,"available":96062988288,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9784,"internal_metadata":573364680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.48999999999999999,"15min":0.51500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.80600000000000005,"5min":3.613,"15min":8.8569999999999993},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.46300000000000002,"15min":0.57499999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26400000000000001},"max":{"1min":0.49299999999999999,"5min":0.72799999999999998,"15min":12.231999999999999},"last":0.503}]},{"osd":1,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64600000000000002,"5min":2.1509999999999998,"15min":2.1960000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26800000000000002},"max":{"1min":0.83799999999999997,"5min":2.085,"15min":2.4180000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.495,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":2.3730000000000002},"last":0.379},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50800000000000001,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":8.8330000000000002},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54500000000000004,"5min":10.359,"15min":12.275},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.53600000000000003,"15min":0.624},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":9.0269999999999992},"last":0.47899999999999998}]},{"osd":5,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.50800000000000001,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.246},"max":{"1min":0.86399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.48899999999999999,"15min":0.60399999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63300000000000001,"5min":0.749,"15min":12.298},"last":0.53600000000000003}]},{"osd":6,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51700000000000002,"15min":0.61499999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.26600000000000001},"max":{"1min":0.67600000000000005,"5min":0.75600000000000001,"15min":15.207000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.55300000000000005,"15min":0.626},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":8.7959999999999994},"last":0.46999999999999997}]},{"osd":7,"last update":"Tue Dec 19 15:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.54800000000000004,"15min":0.66300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":18.420999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.60099999999999998,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.782,"15min":15.164999999999999},"last":0.54900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834576068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":591048,"kb_used_data":384,"kb_used_omap":59,"kb_used_meta":590596,"kb_avail":93780792,"statfs":{"total":96636764160,"available":96031531008,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60700,"internal_metadata":604771044},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.36699999999999999,"15min":0.54300000000000004},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.83999999999999997,"5min":4.1130000000000004,"15min":31.536000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.376,"15min":0.57399999999999995},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.433,"5min":3.2040000000000002,"15min":31.611000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.372,"15min":0.50600000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.65800000000000003,"5min":3.875,"15min":22.16},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.41299999999999998,"15min":0.49399999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64700000000000002,"5min":3.1789999999999998,"15min":10.189},"last":0.40799999999999997}]},{"osd":2,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.40400000000000003,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57499999999999996,"5min":3.9780000000000002,"15min":22.777000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41799999999999998,"15min":0.46700000000000003},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56899999999999995,"5min":3.8340000000000001,"15min":9.4830000000000005},"last":0.36699999999999999}]},{"osd":4,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.55500000000000005,"15min":0.68200000000000005},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.72599999999999998,"5min":3.1110000000000002,"15min":13.738},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.58499999999999996,"15min":0.67000000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60099999999999998,"5min":3.9279999999999999,"15min":9.3439999999999994},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.59399999999999997,"15min":0.66900000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.56399999999999995,"5min":4.0359999999999996,"15min":10.439},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.70299999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74099999999999999,"5min":1.0629999999999999,"15min":10.253},"last":0.44800000000000001}]},{"osd":6,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.621,"15min":0.67600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98899999999999999,"5min":4.0730000000000004,"15min":5.585},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.56200000000000006,"15min":0.67200000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77200000000000002,"5min":1.0920000000000001,"15min":9.5180000000000007},"last":0.53200000000000003}]},{"osd":7,"last update":"Tue Dec 19 15:14:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57299999999999995,"15min":0.75800000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":1.1220000000000001,"15min":22.117000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.60399999999999998,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91700000000000004,"5min":3.1459999999999999,"15min":9.7390000000000008},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834576070,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1628228,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":1627840,"kb_avail":92743612,"statfs":{"total":96636764160,"available":94969458688,"internally_reserved":0,"allocated":389120,"data_stored":150892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1666908160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36899999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":5.1779999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.36499999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":1.659,"5min":1.659,"15min":8.5459999999999994},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.379,"15min":0.40500000000000003},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":6.367},"last":0.247},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.435},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":5.2859999999999996},"last":0.26100000000000001}]},{"osd":3,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.3359999999999999,"5min":3.5339999999999998,"15min":8.1910000000000007},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.133,"5min":2.133,"15min":5.3129999999999997},"last":0.35099999999999998}]},{"osd":4,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.311},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":5.2169999999999996},"last":0.433},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.63700000000000001,"15min":0.67700000000000005},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.32500000000000001},"max":{"1min":1.615,"5min":7.1580000000000004,"15min":10.959},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":0.79300000000000004,"15min":0.71299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":21.978999999999999,"5min":21.978999999999999,"15min":21.978999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.3520000000000001,"5min":0.745,"15min":0.68100000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":20.068999999999999,"5min":20.068999999999999,"15min":20.068999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.64700000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.637,"5min":7.048,"15min":8.4979999999999993},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":2.2789999999999999,"5min":3.5640000000000001,"15min":11.66},"last":0.51500000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":8.5239999999999991},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65500000000000003,"15min":0.70499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.3119999999999998,"5min":3.496,"15min":20.228000000000002},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834576068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":531848,"kb_used_data":384,"kb_used_omap":1132,"kb_used_meta":530323,"kb_avail":93839992,"statfs":{"total":96636764160,"available":96092151808,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1159777,"internal_metadata":543051167},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.51600000000000001},"min":{"1min":0.189,"5min":0.189,"15min":0.17100000000000001},"max":{"1min":4.306,"5min":4.306,"15min":38.348999999999997},"last":0.311},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.54300000000000004,"15min":0.76900000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":2.048,"5min":9.0150000000000006,"15min":73.376000000000005},"last":0.29899999999999999}]},{"osd":2,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.48799999999999999,"15min":0.65300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.186},"max":{"1min":3.0510000000000002,"5min":3.9140000000000001,"15min":68.296000000000006},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61799999999999999,"15min":0.80800000000000005},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":1.7070000000000001,"5min":9.0839999999999996,"15min":73.349999999999994},"last":0.33200000000000002}]},{"osd":3,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":3.8679999999999999,"15min":8.282},"last":0.253},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.435}]},{"osd":4,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":1.038},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":4.3529999999999998,"5min":5.9290000000000003,"15min":72.754999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":18.861000000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.71299999999999997,"15min":0.66800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77100000000000002,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.3879999999999999,"5min":5.9560000000000004,"15min":72.823999999999998},"last":0.39600000000000002}]},{"osd":6,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":1.0580000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.35199999999999998},"max":{"1min":4.4180000000000001,"5min":6.008,"15min":72.792000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":3.101,"5min":4.1790000000000003,"15min":5.9710000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Tue Dec 19 15:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.66100000000000003,"15min":0.70999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89800000000000002,"5min":4.0300000000000002,"15min":13.942},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.755},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.5920000000000001,"5min":4.1479999999999997,"15min":22.631},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834576070,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1362376,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":1361408,"kb_avail":93009464,"statfs":{"total":96636764160,"available":95241691136,"internally_reserved":0,"allocated":983040,"data_stored":741260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1394081792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":7.0730000000000004,"5min":7.0730000000000004,"15min":11.076000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.875,"5min":1.3819999999999999,"15min":9.5969999999999995},"last":0.313}]},{"osd":2,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.51500000000000001,"15min":0.58299999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.1509999999999998,"5min":7.1509999999999998,"15min":30.41},"last":0.379},{"interface":"front","average":{"1min":1.1759999999999999,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24399999999999999},"max":{"1min":13.970000000000001,"5min":13.970000000000001,"15min":13.970000000000001},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.58099999999999996,"15min":0.55400000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":7.2919999999999998,"5min":9.984,"15min":15.484},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":7.1299999999999999,"5min":12.144,"15min":12.144},"last":0.40600000000000003}]},{"osd":4,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.57999999999999996,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":9.109},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.72199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.125,"5min":2.04,"15min":18.951000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":11.426,"5min":11.426,"15min":11.426},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.0419999999999998,"5min":7.0419999999999998,"15min":12.074999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.1059999999999999,"5min":7.1059999999999999,"15min":9.4429999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":9.6340000000000003},"last":0.63400000000000001}]},{"osd":7,"last update":"Tue Dec 19 15:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":7.3550000000000004,"5min":7.3550000000000004,"15min":12.129},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38500000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":7.3540000000000001},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T15:14:40.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T15:14:40.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.852+0000 7fe5f7fff640 1 Processor -- start 2023-12-19T15:14:40.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.852+0000 7fe5f7fff640 1 -- start start 2023-12-19T15:14:40.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f80bac50 0x7fe5f80b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f7fff640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80b5000 con 0x7fe5f80b5550 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f7fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80b9510 con 0x7fe5f8142c90 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f7fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b49b0 con 0x7fe5f80bac50 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f67fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe5f80b5550 0x7fe5f8142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54284/0 (socket says 172.21.15.6:54284) 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f67fc640 1 -- 172.21.15.6:0/1049300149 learned_addr learned my addr 172.21.15.6:0/1049300149 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f6ffd640 1 --2- 172.21.15.6:0/1049300149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f80bac50 0x7fe5f80b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150292073 0 0) 0x7fe5f80b5000 con 0x7fe5f80b5550 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.853+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e4003520 con 0x7fe5f80b5550 2023-12-19T15:14:40.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529967883 0 0) 0x7fe5f80b9510 con 0x7fe5f8142c90 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f80b5000 con 0x7fe5f8142c90 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2689922053 0 0) 0x7fe5e4003520 con 0x7fe5f80b5550 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1049300149 >> v1:172.21.15.89:6789/0 conn(0x7fe5f8142c90 legacy=0x7fe5f8153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1049300149 >> v1:172.21.15.6:6789/0 conn(0x7fe5f80b5550 legacy=0x7fe5f8142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1049300149 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80b4c90 con 0x7fe5f80bac50 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.854+0000 7fe5f6ffd640 1 --2- 172.21.15.6:0/1049300149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f80bac50 0x7fe5f80b8fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009800 tx=0x7fe5e802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203b50432b3820ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0001670 con 0x7fe5f80bac50 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e8031560 con 0x7fe5f80bac50 2023-12-19T15:14:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f5ffb640 1 -- 172.21.15.6:0/1049300149 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80318d0 con 0x7fe5f80bac50 2023-12-19T15:14:40.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1049300149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f80bac50 msgr2=0x7fe5f80b8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1049300149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f80bac50 0x7fe5f80b8fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009800 tx=0x7fe5e802b880 comp rx=0 tx=0).stop 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1049300149 shutdown_connections 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1049300149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f80bac50 0x7fe5f80b8fd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1049300149 >> 172.21.15.6:0/1049300149 conn(0x7fe5f80bdf90 msgr2=0x7fe5f80be370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1049300149 shutdown_connections 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.855+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1049300149 wait complete. 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.856+0000 7fe5f7fff640 1 Processor -- start 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.856+0000 7fe5f7fff640 1 -- start start 2023-12-19T15:14:40.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 0x7fe5f8148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f80bac50 0x7fe5f8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f8142c90 0x7fe5f8146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f7fff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8145f30 con 0x7fe5f80b5550 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f7fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8147d70 con 0x7fe5f80bac50 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f7fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81459c0 con 0x7fe5f8142c90 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 0x7fe5f8148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 0x7fe5f8148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58800/0 (socket says 172.21.15.6:58800) 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1523465449 learned_addr learned my addr 172.21.15.6:0/1523465449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:40.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f67fc640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f80bac50 0x7fe5f8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f77fe640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f8142c90 0x7fe5f8146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.857+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f8142c90 msgr2=0x7fe5f8146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f6ffd640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f8142c90 0x7fe5f8146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f80bac50 msgr2=0x7fe5f8147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f6ffd640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f80bac50 0x7fe5f8147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f6ffd640 1 -- 172.21.15.6:0/1523465449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8009400 con 0x7fe5f80b5550 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f67fc640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f80bac50 0x7fe5f8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f77fe640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f8142c90 0x7fe5f8146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:40.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f6ffd640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 0x7fe5f8148870 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e803b5f0 con 0x7fe5f80b5550 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e803b750 con 0x7fe5f80b5550 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e803bae0 con 0x7fe5f80b5550 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8146110 con 0x7fe5f80b5550 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.858+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8137480 con 0x7fe5f80b5550 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.859+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f8142a60 con 0x7fe5f80b5550 2023-12-19T15:14:40.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.860+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5e803bc40 con 0x7fe5f80b5550 2023-12-19T15:14:40.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.860+0000 7fe5ef7fe640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5d806a460 0x7fe5d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:40.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.860+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5e802f050 con 0x7fe5f80b5550 2023-12-19T15:14:40.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.860+0000 7fe5f67fc640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5d806a460 0x7fe5d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:40.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.861+0000 7fe5f67fc640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5d806a460 0x7fe5d806c920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5f813f3b0 tx=0x7fe5e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:40.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:40.868+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe5e8075b10 con 0x7fe5f80b5550 2023-12-19T15:14:41.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.044+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe5f8061910 con 0x7fe5f80b5550 2023-12-19T15:14:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.048+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe5e8075b10 con 0x7fe5f80b5550 2023-12-19T15:14:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.048+0000 7fe5ef7fe640 1 -- 172.21.15.6:0/1523465449 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe5e8079130 con 0x7fe5f80b5550 2023-12-19T15:14:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5d806a460 msgr2=0x7fe5d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5d806a460 0x7fe5d806c920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5f813f3b0 tx=0x7fe5e0009040 comp rx=0 tx=0).stop 2023-12-19T15:14:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 msgr2=0x7fe5f8148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 0x7fe5f8148870 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e80046c0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 shutdown_connections 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7fe5d806a460 0x7fe5d806c920 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f8142c90 0x7fe5f8146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f80bac50 0x7fe5f8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 --2- 172.21.15.6:0/1523465449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f80b5550 0x7fe5f8148870 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 >> 172.21.15.6:0/1523465449 conn(0x7fe5f80bdf90 msgr2=0x7fe5f8142350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 shutdown_connections 2023-12-19T15:14:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.051+0000 7fe5f7fff640 1 -- 172.21.15.6:0/1523465449 wait complete. 2023-12-19T15:14:41.062 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T15:14:41.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T15:14:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.167+0000 7f9293e77640 1 Processor -- start 2023-12-19T15:14:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.167+0000 7f9293e77640 1 -- start start 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9293e77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c06a6d0 0x7f928c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9293e77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f928c14b1f0 0x7f928c0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9293e77640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f928c0ba550 0x7f928c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9293e77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0bb310 con 0x7f928c14b1f0 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9293e77640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0bf960 con 0x7f928c0ba550 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9293e77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0bb5b0 con 0x7f928c06a6d0 2023-12-19T15:14:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f928c14b1f0 0x7f928c0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f928c14b1f0 0x7f928c0b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58812/0 (socket says 172.21.15.6:58812) 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 -- 172.21.15.6:0/1637182153 learned_addr learned my addr 172.21.15.6:0/1637182153 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291c13640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c06a6d0 0x7f928c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9292414640 1 --2- 172.21.15.6:0/1637182153 >> v2:172.21.15.89:3300/0 conn(0x7f928c0ba550 0x7f928c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 -- 172.21.15.6:0/1637182153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c06a6d0 msgr2=0x7f928c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c06a6d0 0x7f928c14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 -- 172.21.15.6:0/1637182153 >> v2:172.21.15.89:3300/0 conn(0x7f928c0ba550 msgr2=0x7f928c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.168+0000 7f9291412640 1 --2- 172.21.15.6:0/1637182153 >> v2:172.21.15.89:3300/0 conn(0x7f928c0ba550 0x7f928c14e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.169+0000 7f9291412640 1 -- 172.21.15.6:0/1637182153 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c0c0120 con 0x7f928c14b1f0 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.169+0000 7f9292414640 1 --2- 172.21.15.6:0/1637182153 >> v2:172.21.15.89:3300/0 conn(0x7f928c0ba550 0x7f928c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.169+0000 7f9291c13640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c06a6d0 0x7f928c14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9291412640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c14b1f0 0x7f928c0b9ac0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f928c067260 tx=0x7f928002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4e2c3ac53d12d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9290c11640 1 -- 172.21.15.6:0/1637182153 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280031860 con 0x7f928c14b1f0 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9290c11640 1 -- 172.21.15.6:0/1637182153 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f92800319c0 con 0x7f928c14b1f0 2023-12-19T15:14:41.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9290c11640 1 -- 172.21.15.6:0/1637182153 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280031d70 con 0x7f928c14b1f0 2023-12-19T15:14:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 -- 172.21.15.6:0/1637182153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c14b1f0 msgr2=0x7f928c0b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c14b1f0 0x7f928c0b9ac0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f928c067260 tx=0x7f928002b900 comp rx=0 tx=0).stop 2023-12-19T15:14:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 -- 172.21.15.6:0/1637182153 shutdown_connections 2023-12-19T15:14:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 --2- 172.21.15.6:0/1637182153 >> v2:172.21.15.89:3300/0 conn(0x7f928c0ba550 0x7f928c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c14b1f0 0x7f928c0b9ac0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 --2- 172.21.15.6:0/1637182153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c06a6d0 0x7f928c14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 -- 172.21.15.6:0/1637182153 >> 172.21.15.6:0/1637182153 conn(0x7f928c0c0350 msgr2=0x7f928c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.170+0000 7f9293e77640 1 -- 172.21.15.6:0/1637182153 shutdown_connections 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.171+0000 7f9293e77640 1 -- 172.21.15.6:0/1637182153 wait complete. 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 Processor -- start 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 -- start start 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 0x7f928c14c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ba550 0x7f928c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c14b1f0 0x7f928c14e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14eac0 con 0x7f928c06a6d0 2023-12-19T15:14:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14c860 con 0x7f928c0ba550 2023-12-19T15:14:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9293e77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14cad0 con 0x7f928c14b1f0 2023-12-19T15:14:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9291c13640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 0x7f928c14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9291c13640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 0x7f928c14c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58822/0 (socket says 172.21.15.6:58822) 2023-12-19T15:14:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9291c13640 1 -- 172.21.15.6:0/1499614770 learned_addr learned my addr 172.21.15.6:0/1499614770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9291412640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ba550 0x7f928c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.172+0000 7f9292414640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c14b1f0 0x7f928c14e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9291c13640 1 -- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c14b1f0 msgr2=0x7f928c14e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9291c13640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c14b1f0 0x7f928c14e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9291c13640 1 -- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ba550 msgr2=0x7f928c14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9291c13640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ba550 0x7f928c14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9291c13640 1 -- 172.21.15.6:0/1499614770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800094d0 con 0x7f928c06a6d0 2023-12-19T15:14:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9291c13640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 0x7f928c14c320 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c820 tx=0x7f927c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c007a30 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f927c007b90 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c1dfc50 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c00ce70 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.173+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c1e0210 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.174+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c073a40 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.174+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f927c0113f0 con 0x7f928c06a6d0 2023-12-19T15:14:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.175+0000 7f928a7fc640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f927806a430 0x7f927806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T15:14:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.175+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f927c088790 con 0x7f928c06a6d0 2023-12-19T15:14:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.175+0000 7f9291412640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f927806a430 0x7f927806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T15:14:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.176+0000 7f9291412640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f927806a430 0x7f927806c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9280036000 tx=0x7f928003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T15:14:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.179+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f927c0540a0 con 0x7f928c06a6d0 2023-12-19T15:14:41.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.390+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f928c0b70e0 con 0x7f928c06a6d0 2023-12-19T15:14:41.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.391+0000 7f928a7fc640 1 -- 172.21.15.6:0/1499614770 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2766 (secure 0 0 0) 0x7f927c01f090 con 0x7f928c06a6d0 2023-12-19T15:14:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-12-19T15:14:41.391 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3544444089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3544444089},{"type":"v1","addr":"172.21.15.89:6835","nonce":3544444089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/1471131016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1471131016},{"type":"v1","addr":"172.21.15.6:6833","nonce":1471131016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":6678,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3660467577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3660467577},{"type":"v1","addr":"172.21.15.6:6835","nonce":3660467577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-12-19T15:14:41.392 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.392+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f927806a430 msgr2=0x7f927806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.392+0000 7f9293e77640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f927806a430 0x7f927806c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9280036000 tx=0x7f928003c040 comp rx=0 tx=0).stop 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.392+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 msgr2=0x7f928c14c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.392+0000 7f9293e77640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 0x7f928c14c320 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f927c00c820 tx=0x7f927c00cc20 comp rx=0 tx=0).stop 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 shutdown_connections 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:6832/88967,v1:172.21.15.89:6833/88967] conn(0x7f927806a430 0x7f927806c8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928c14b1f0 0x7f928c14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f928c0ba550 0x7f928c14e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 --2- 172.21.15.6:0/1499614770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928c06a6d0 0x7f928c14c320 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T15:14:41.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 >> 172.21.15.6:0/1499614770 conn(0x7f928c0c0350 msgr2=0x7f928c09fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T15:14:41.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 shutdown_connections 2023-12-19T15:14:41.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-12-19T15:14:41.393+0000 7f9293e77640 1 -- 172.21.15.6:0/1499614770 wait complete. 2023-12-19T15:14:41.403 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T15:14:41.403 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T15:14:41.404 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T15:14:41.404 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:41.412 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T15:14:41.413 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T15:14:41.413 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:41.465 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T15:14:41.465 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T15:14:41.465 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:41.477 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T15:14:41.477 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T15:14:41.477 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T15:14:41.478 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:44.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-19T15:14:47.579 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T15:14:47.580 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T15:14:47.580 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:47.655 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T15:14:47.655 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T15:14:47.655 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:47.743 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T15:14:47.743 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T15:14:47.743 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:47.811 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T15:14:47.812 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T15:14:47.812 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:47.880 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T15:14:47.881 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T15:14:47.881 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:47.935 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T15:14:47.936 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T15:14:47.936 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.023 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T15:14:48.023 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T15:14:48.023 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.086 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T15:14:48.087 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T15:14:48.087 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T15:14:48.087 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.113 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T15:14:48.114 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T15:14:48.114 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.144 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T15:14:48.144 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T15:14:48.144 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T15:14:48.145 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.170 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T15:14:48.171 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T15:14:48.171 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.199 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T15:14:48.199 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T15:14:48.199 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T15:14:48.252 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T15:14:48.253 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T15:14:48.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T15:14:48.331 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T15:14:48.332 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T15:14:48.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T15:14:48.625 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T15:14:48.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T15:14:48.771 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T15:14:48.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T15:14:48.868 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T15:14:48.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T15:14:48.973 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T15:14:49.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T15:14:49.227 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T15:14:49.361 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T15:14:49.361 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T15:14:49.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T15:14:49.479 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T15:14:49.629 INFO:tasks.ceph:Archiving mon data... 2023-12-19T15:14:49.630 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/data/mon.a.tgz 2023-12-19T15:14:49.631 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-12-19T15:14:49.648 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.QkpvEzS6SJ 2023-12-19T15:14:49.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QkpvEzS6SJ 2023-12-19T15:14:49.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-19T15:14:49.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.QkpvEzS6SJ 2023-12-19T15:14:49.856 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.QkpvEzS6SJ is 292KB 2023-12-19T15:14:49.953 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.QkpvEzS6SJ 2023-12-19T15:14:49.978 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/data/mon.b.tgz 2023-12-19T15:14:49.978 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-19T15:14:50.002 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.TSwVeeT9Am 2023-12-19T15:14:50.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TSwVeeT9Am 2023-12-19T15:14:50.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.TSwVeeT9Am 2023-12-19T15:14:50.223 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.TSwVeeT9Am is 293KB 2023-12-19T15:14:50.319 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.TSwVeeT9Am 2023-12-19T15:14:50.349 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/data/mon.c.tgz 2023-12-19T15:14:50.349 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-19T15:14:50.402 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.ZCnQxv0DjN 2023-12-19T15:14:50.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZCnQxv0DjN 2023-12-19T15:14:50.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.ZCnQxv0DjN 2023-12-19T15:14:50.598 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.ZCnQxv0DjN is 293KB 2023-12-19T15:14:50.666 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.ZCnQxv0DjN 2023-12-19T15:14:50.681 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T15:14:50.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T15:14:50.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T15:14:50.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T15:14:50.821 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T15:14:50.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T15:14:50.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T15:14:50.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T15:14:50.852 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T15:14:50.857 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T15:14:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T15:14:50.966 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T15:14:50.968 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi006/crash 2023-12-19T15:14:50.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T15:14:51.001 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi089/crash 2023-12-19T15:14:51.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T15:14:51.029 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi144/crash 2023-12-19T15:14:51.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T15:14:51.160 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T15:14:51.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:51.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:51.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:51.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:51.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:51.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:51.473 INFO:tasks.ceph:Compressing logs... 2023-12-19T15:14:51.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T15:14:51.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T15:14:51.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T15:18:41.816 INFO:tasks.ceph:Archiving logs... 2023-12-19T15:18:41.817 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi006/log 2023-12-19T15:18:41.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T15:21:15.396 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi089/log 2023-12-19T15:21:15.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T15:22:17.836 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi144/log 2023-12-19T15:22:17.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T15:22:18.992 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T15:22:19.012 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T15:22:19.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T15:22:19.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T15:22:19.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T15:22:19.200 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T15:22:19.213 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T15:22:19.214 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T15:22:19.217 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T15:22:19.220 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T15:22:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2023-12-19T15:22:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-12-19T15:22:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2023-12-19T15:22:19.302 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T15:22:19.303 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-12-19T15:22:19.303 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 129 -286us[ -286us] +/- 84ms 2023-12-19T15:22:19.303 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 8 377 130 -507us[ -512us] +/- 77ms 2023-12-19T15:22:19.303 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +1101us[+1101us] +/- 80ms 2023-12-19T15:22:19.303 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T15:22:19.327 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T15:22:19.327 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-12-19T15:22:19.327 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 -355us[ -347us] +/- 69ms 2023-12-19T15:22:19.327 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -585us[ -576us] +/- 79ms 2023-12-19T15:22:19.328 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +1035us[+1035us] +/- 81ms 2023-12-19T15:22:19.328 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T15:22:19.335 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T15:22:19.335 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-12-19T15:22:19.335 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 -368us[ -371us] +/- 69ms 2023-12-19T15:22:19.335 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -601us[ -604us] +/- 79ms 2023-12-19T15:22:19.336 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +1008us[+1005us] +/- 81ms 2023-12-19T15:22:19.336 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T15:22:19.352 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T15:22:19.363 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T15:22:19.363 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T15:22:19.372 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T15:22:19.698 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T15:22:19.870 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T15:22:20.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T15:22:20.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:22:20.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T15:22:20.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:22:20.328 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T15:22:20.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:22:20.438 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T15:22:20.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T15:22:20.457 INFO:teuthology.task.internal:Duration was 7326.691774 seconds 2023-12-19T15:22:20.458 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T15:22:20.467 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T15:22:20.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T15:22:20.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T15:22:20.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T15:22:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T15:22:20.545 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T15:22:20.697 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T15:22:20.925 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T15:22:20.925 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-12-19T15:22:20.925 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T15:22:20.949 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-12-19T15:22:20.950 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T15:22:20.986 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2023-12-19T15:22:20.987 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T15:22:21.074 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T15:22:21.074 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T15:22:21.076 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T15:22:21.079 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T15:22:21.168 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T15:22:21.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T15:22:21.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T15:22:21.174 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T15:22:21.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T15:22:21.464 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T15:22:21.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T15:22:21.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T15:22:21.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T15:22:21.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T15:22:21.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T15:22:21.688 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T15:22:21.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T15:22:21.720 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-12-19T15:22:21.729 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-12-19T15:22:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2023-12-19T15:22:21.866 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T15:22:21.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:22:21.881 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T15:22:21.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:22:21.895 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T15:22:21.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:22:21.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T15:22:21.959 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T15:22:21.960 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi006 2023-12-19T15:22:21.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T15:22:22.000 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi089 2023-12-19T15:22:22.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T15:22:22.038 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743/remote/smithi144 2023-12-19T15:22:22.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T15:22:22.148 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T15:22:22.149 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T15:22:22.151 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T15:22:22.153 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T15:22:22.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T15:22:22.225 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T15:22:22.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T15:22:22.236 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T15:22:22.237 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T15:22:22.239 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T15:22:22.241 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T15:22:22.252 INFO:teuthology.orchestra.run.smithi006.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 15:22 /home/ubuntu/cephtest 2023-12-19T15:22:22.253 INFO:teuthology.orchestra.run.smithi089.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 15:22 /home/ubuntu/cephtest 2023-12-19T15:22:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 15:22 /home/ubuntu/cephtest 2023-12-19T15:22:22.300 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T15:22:22.311 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T15:22:22.381 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T15:22:22.407 DEBUG:teuthology.nuke:shortname: smithi006 2023-12-19T15:22:22.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:22:22.430 DEBUG:teuthology.nuke:shortname: smithi089 2023-12-19T15:22:22.430 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:22:22.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:11:15.046341', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdsdD00jk52f4SWwlcJkgBPxt6Hn8KZrl/wOFbZYoGWzRuWx2g+4x7d6HAh86IW3vRDLEs1ebQbL6QuOfledIM='} 2023-12-19T15:22:22.452 DEBUG:teuthology.nuke:shortname: smithi144 2023-12-19T15:22:22.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:22:22.457 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:11:15.044353', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKggtyj6U7Gk0UCx1j07DqC5wBpV9T8wtNedcMCOSHXgw2q3m3rvhpWBpbR+BZw4t/0H2ia/LAGk4XTjX0I9rxs='} 2023-12-19T15:22:22.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496743', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:11:15.048010', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9HyulgJ5+WUTJbHQmdc6OtfTBq6eIKRbLsXZgrQ5P2uOwJpnxE+Q3WFa8r6914xk9yv3FleqXShjQ4DzdSSMY='} 2023-12-19T15:22:22.487 INFO:teuthology.orchestra.console.smithi006:Power off 2023-12-19T15:22:22.487 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:22:22.516 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-12-19T15:22:22.516 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:22.537 INFO:teuthology.orchestra.console.smithi144:Power off 2023-12-19T15:22:22.538 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:22:22.556 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-19T15:22:22.556 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:22:22.565 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-12-19T15:22:22.565 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-12-19T15:22:22.565 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:22.579 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-19T15:22:22.580 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:22.590 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-19T15:22:22.604 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-19T15:22:26.566 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:26.591 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:26.605 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:26.679 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-12-19T15:22:26.701 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-19T15:22:26.714 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-19T15:22:30.681 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:30.702 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:30.715 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:30.794 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-12-19T15:22:30.819 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-12-19T15:22:30.827 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-19T15:22:30.895 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-12-19T15:22:30.929 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-19T15:22:34.821 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:22:34.935 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-12-19T15:22:35.036 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-12-19T15:22:35.141 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} duration: 7326.69177365303 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5b51daa51e3e45bc860ef33a24a8572d status: fail success: false 2023-12-19T15:22:35.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:22:35.220 INFO:teuthology.run:FAIL